Apr 21 01:58:41 devstack cinder-volume[72509]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 21 01:58:41 devstack cinder-volume[72509]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 01:58:41 devstack cinder-volume[72509]: we strongly recommend against using it for new projects. Apr 21 01:58:41 devstack cinder-volume[72509]: If you are already using Eventlet, we recommend migrating to a different Apr 21 01:58:41 devstack cinder-volume[72509]: framework. For more detail see Apr 21 01:58:41 devstack cinder-volume[72509]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 01:58:41 devstack cinder-volume[72509]: import eventlet # noqa Apr 21 01:58:42 devstack cinder-volume[72509]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72509) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 01:58:42 devstack cinder-volume[72509]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72509) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 01:58:42 devstack cinder-volume[72509]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72509) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 01:58:43 devstack cinder-volume[72509]: INFO dbcounter [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Registered counter for database cinder Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_db.sqlalchemy.engines [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72509) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG dbcounter [-] [72509] Writer thread running {{(pid=72509) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 01:58:43 devstack cinder-volume[72509]: INFO cinder.rpc [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 21 01:58:43 devstack cinder-volume[72509]: INFO cinder.rpc [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_db.sqlalchemy.engines [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72509) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 01:58:43 devstack cinder-volume[72509]: INFO cinder.volume.manager [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Determined volume DB was empty at startup. Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG cinder.volume.manager [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72509) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 21 01:58:43 devstack cinder-volume[72509]: INFO cinder.volume.manager [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 21 01:58:43 devstack cinder-volume[72509]: WARNING stevedore.named [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 01:58:43 devstack cinder-volume[72509]: WARNING castellan.key_manager [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 01:58:43 devstack cinder-volume[72509]: WARNING cinder.keymgr.conf_key_mgr [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG cinder.volume.drivers.lvm [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72509) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_concurrency.processutils [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72509) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_concurrency.processutils [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] CMD "cinder-rtstool verify" returned: 0 in 0.236s {{(pid=72509) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_db.sqlalchemy.engines [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72509) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 01:58:43 devstack cinder-volume[72509]: INFO cinder.rpc [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 21 01:58:43 devstack cinder-volume[72509]: INFO cinder.rpc [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 21 01:58:43 devstack cinder-volume[72509]: WARNING stevedore.named [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 01:58:43 devstack cinder-volume[72509]: WARNING castellan.key_manager [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 01:58:43 devstack cinder-volume[72509]: INFO cinder.volume.manager [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_db.sqlalchemy.engines [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72509) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 01:58:43 devstack cinder-volume[72509]: INFO oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Starting 1 workers Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Started child 72613 {{(pid=72509) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Full set of CONF: {{(pid=72509) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] ******************************************************************************** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Configuration options gathered from: {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] ================================================================================ {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] allow_availability_zone_fallback = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] allow_compression_on_image_upload = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] allowed_direct_url_schemes = [] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] api_rate_limit = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] auth_strategy = keystone {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] az_cache_duration = 3600 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_availability_zone = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_host = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_name = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_stats_polling_interval = 60 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backup_api_class = cinder.backup.api.API {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backup_name_template = backup-%s {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backup_use_same_host = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backup_use_temp_snapshot = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] chap_password = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] chap_username = {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cinder_internal_tenant_project_id = 5a55a393f38c4b868cf6ebca22880392 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cinder_internal_tenant_user_id = 6fb683d985454b8384fddb5a46789ca6 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cloned_volume_same_az = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cluster = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] compression_format = gzip {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] compute_api_class = cinder.compute.nova.API {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] config_dir = [] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] config_source = [] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] control_exchange = openstack {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] debug = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] default_availability_zone = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] default_group_type = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] default_volume_type = lvmdriver-1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] disk_geometry = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] driver_client_cert = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] driver_client_cert_key = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] driver_data_namespace = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] driver_ssl_cert_path = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] driver_ssl_cert_verify = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] driver_use_ssl = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] enable_force_upload = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] enable_new_services = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] enable_unsupported_driver = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] enabled_backends = ['lvmdriver-1'] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] enforce_multipath_for_image_xfer = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] filter_function = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance_api_insecure = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72613]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance_api_servers = ['http://192.168.122.200/image'] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance_api_ssl_compression = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance_ca_certificates_file = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance_catalog_info = image:glance:publicURL {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance_certfile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance_keyfile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance_num_retries = 3 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance_request_timeout = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] goodness_function = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] graceful_shutdown_timeout = 5 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] group_api_class = cinder.group.api.API {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] host = devstack {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] image_compress_on_upload = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] image_conversion_address_space_limit = 1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] image_conversion_cpu_limit = 60 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] image_conversion_disable = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] image_upload_use_cinder_backend = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] image_upload_use_internal_tenant = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] image_volume_cache_enabled = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] image_volume_cache_max_count = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] image_volume_cache_max_size_gb = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] init_host_max_objects_retrieval = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] instance_format = [instance: %(uuid)s] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] iscsi_target_flags = {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] iscsi_write_cache = on {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] iser_helper = tgtadm {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] iser_ip_address = 192.168.122.200 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] iser_port = 3260 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] log_color = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] log_config_append = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] log_dir = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] log_file = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] log_options = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] log_rotate_interval = 1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] log_rotate_interval_type = days {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] log_rotation_type = none {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] max_age = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] max_logfile_count = 30 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] max_logfile_size_mb = 200 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] max_over_subscription_ratio = 20.0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] message_reap_interval = 86400 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] message_ttl = 2592000 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] migration_create_volume_timeout_secs = 300 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] monkey_patch = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72613]: INFO cinder.volume.manager [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] monkey_patch_modules = [] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] my_ip = 192.168.122.200 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] no_snapshot_gb_quota = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] num_iser_scan_tries = 3 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] num_shell_tries = 3 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] num_volume_device_scan_tries = 3 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] nvmeof_conn_info_version = 1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] nvmet_ns_id = 10 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] nvmet_port_id = 1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] osapi_max_limit = 1000 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] osapi_volume_ext_list = [] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] osapi_volume_listen = 0.0.0.0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] osapi_volume_listen_port = 8776 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] osapi_volume_use_ssl = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] osapi_volume_workers = 2 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] per_volume_size_limit = -1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] periodic_fuzzy_delay = 60 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] periodic_interval = 60 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] project_id_regex = [0-9a-f\-]+ {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] public_endpoint = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] publish_errors = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] quota_backup_gigabytes = 1000 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] quota_backups = 10 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] quota_gigabytes = 1000 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] quota_groups = 10 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] quota_snapshots = 10 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] quota_volumes = 10 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] rate_limit_burst = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] rate_limit_except_level = CRITICAL {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] rate_limit_interval = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] reinit_driver_count = 3 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] replication_device = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] report_discard_supported = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] report_interval = 120 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] reservation_clean_interval = 86400 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] reservation_expire = 86400 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] reserved_image_namespaces = [] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] reserved_percentage = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] rpc_response_timeout = 120 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] run_external_periodic_tasks = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] scst_target_driver = iscsi {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] scst_target_iqn_name = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] service_down_time = 720 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] shell_completion = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] snapshot_name_template = snapshot-%s {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] snapshot_same_host = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] split_loggers = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] state_path = /opt/stack/data/cinder {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] storage_availability_zone = nova {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] storage_protocol = iSCSI {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] syslog_log_facility = LOG_USER {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] target_helper = lioadm {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] target_ip_address = 192.168.122.200 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] target_port = 3260 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] target_protocol = iscsi {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] target_secondary_ip_addresses = [] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] trace_flags = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] transfer_api_class = cinder.transfer.api.API {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] transport_url = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] until_refresh = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] use_chap_auth = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] use_default_quota_class = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] use_journal = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] use_json = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] use_multipath_for_image_xfer = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] use_stderr = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] use_syslog = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] verify_glance_signatures = enabled {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] volume_api_class = cinder.volume.api.API {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] volume_backend_name = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] volume_clear = zero {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] volume_clear_ionice = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] volume_clear_size = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] volume_copy_bps_limit = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] volume_dd_blocksize = 1M {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] volume_name_template = volume-%s {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] volume_service_inithost_offload = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] volume_usage_audit_period = month {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] zoning_mode = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 01:58:43 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_concurrency.disable_process_locking = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.admin_password = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.admin_token = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.admin_user = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.auth_admin_prefix = {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.auth_port = 35357 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.auth_protocol = https {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.auth_section = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.auth_type = password {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.auth_uri = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.auth_version = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.cache = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.certfile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.delay_auth_decision = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.http_connect_timeout = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.identity_uri = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.include_service_catalog = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.insecure = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.interface = public {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.keyfile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.memcache_password = {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.memcache_username = {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.region_name = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.service_token_roles_required = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.service_type = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.token_cache_time = 300 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.200/identity {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.backend = dogpile.cache.null {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.backend_argument = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.backend_expiration_time = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.config_prefix = cache.oslo {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.debug_cache_backend = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.enable_retry_client = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.enable_socket_keepalive = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.enabled = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.enforce_fips_mode = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.expiration_time = 600 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.hashclient_retry_attempts = 2 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.memcache_dead_retry = 300 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.memcache_pool_maxsize = 10 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.memcache_sasl_enabled = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.password = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.proxies = [] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.redis_db = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.redis_sentinel_service_name = mymaster {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.redis_server = localhost:6379 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.retry_attempts = 2 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.retry_delay = 0.0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.socket_keepalive_count = 1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.socket_keepalive_idle = 1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.socket_keepalive_interval = 1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.socket_timeout = 1.0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.tls_allowed_ciphers = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.tls_cafile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.tls_certfile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.tls_enabled = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.tls_keyfile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cache.username = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] coordination.backend_url = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.asyncio_connection = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.asyncio_slave_connection = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.backend = sqlalchemy {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.connection = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.connection_debug = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.connection_parameters = {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.connection_recycle_time = 3600 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.connection_trace = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.db_inc_retry_interval = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.db_max_retries = 20 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.db_max_retry_interval = 10 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.db_retry_interval = 1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.max_overflow = 50 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.max_pool_size = 5 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.max_retries = 10 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.mysql_wsrep_sync_wait = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.pool_timeout = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.retry_interval = 10 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.slave_connection = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.sqlite_synchronous = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.synchronous_reader = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] database.use_db_reconnect = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] profiler.connection_string = messaging:// {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] profiler.enabled = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] profiler.es_doc_type = notification {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] profiler.es_scroll_size = 10000 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] profiler.es_scroll_time = 2m {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] profiler.filter_error_trace = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] profiler.hmac_keys = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] profiler.sentinel_service_name = mymaster {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] profiler.socket_timeout = 0.1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] profiler.trace_requests = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] profiler.trace_sqlalchemy = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] profiler_jaeger.process_tags = {} {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] profiler_jaeger.service_name_prefix = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] profiler_otlp.service_name_prefix = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_policy.enforce_new_defaults = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: WARNING oslo_config.cfg [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_policy.enforce_scope = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_policy.policy_default_rule = default {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_policy.policy_file = policy.yaml {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_policy.remote_timeout = 60.0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] privsep_osbrick.group = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] privsep_osbrick.helper_command = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] privsep_osbrick.user = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cinder_sys_admin.group = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cinder_sys_admin.helper_command = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] cinder_sys_admin.user = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] service_user.auth_section = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] service_user.auth_type = password {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] service_user.cafile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] service_user.certfile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] service_user.collect_timing = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] service_user.insecure = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] service_user.keyfile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] service_user.send_service_user_token = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] service_user.split_loggers = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] service_user.timeout = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance.auth_section = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance.auth_type = password {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance.certfile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance.collect_timing = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance.insecure = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance.keyfile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance.region_name = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance.split_loggers = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] glance.timeout = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.backend_availability_zone = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.chap_password = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.chap_username = {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.disk_geometry = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.driver_client_cert = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.driver_client_cert_key = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.driver_data_namespace = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack sudo[72617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack sudo[72617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.driver_use_ssl = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.enable_unsupported_driver = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.extra_capabilities = {} {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.filter_function = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.goodness_function = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.iscsi_target_flags = {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.iscsi_write_cache = on {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.iser_helper = tgtadm {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.iser_ip_address = 192.168.122.200 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.iser_port = 3260 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.lvm_mirrors = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.lvm_share_target = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.lvm_type = auto {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.num_shell_tries = 3 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.nvmet_port_id = 1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.replication_device = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.report_discard_supported = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.reserved_percentage = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.scst_target_driver = iscsi {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.scst_target_iqn_name = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.storage_protocol = iSCSI {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.target_helper = tgtadm {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.target_ip_address = 192.168.122.200 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.target_port = 3260 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.target_protocol = iscsi {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.trace_flags = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.unique_fqdn_network = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.use_chap_auth = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.volume_backend_name = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.volume_clear = zero {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.volume_clear_ionice = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.volume_clear_size = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.volume_group = cinder-volumes {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_reports.file_event_handler = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_reports.log_dir = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.backend_availability_zone = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.backend_host = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.chap_password = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.chap_username = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.chiscsi_conf = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.disk_geometry = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.driver_client_cert = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.driver_data_namespace = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.driver_use_ssl = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.extra_capabilities = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.filter_function = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.goodness_function = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.iser_helper = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.iser_ip_address = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.iser_port = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.iser_target_prefix = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.lvm_conf_file = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.lvm_mirrors = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.lvm_share_target = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.lvm_type = auto {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.num_shell_tries = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:43 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.nvmet_port_id = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.replication_device = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.report_discard_supported = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.reserved_percentage = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.scst_target_driver = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.storage_protocol = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.target_helper = lioadm {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.target_ip_address = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.target_port = 3260 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.target_protocol = iscsi {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.trace_flags = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.use_chap_auth = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.volume_clear = zero {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.volume_clear_size = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] lvmdriver-1.volumes_dir = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.ssl = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.ssl_version = {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_notifications.driver = [] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_notifications.retry = -1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] oslo_messaging_notifications.transport_url = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] key_manager.fixed_key = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican.barbican_api_version = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican.barbican_endpoint = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican.barbican_endpoint_type = public {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican.barbican_region_name = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican.cafile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican.certfile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican.collect_timing = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican.insecure = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican.keyfile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican.number_of_retries = 60 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican.retry_delay = 1 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican.send_service_user_token = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican.split_loggers = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican.timeout = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican.verify_ssl = True {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican.verify_ssl_path = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican_service_user.auth_section = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican_service_user.auth_type = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican_service_user.cafile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican_service_user.certfile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican_service_user.collect_timing = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican_service_user.insecure = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican_service_user.keyfile = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican_service_user.split_loggers = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] barbican_service_user.timeout = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] vault.approle_role_id = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] vault.approle_secret_id = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] vault.kv_mountpoint = secret {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] vault.kv_path = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] vault.kv_version = 2 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] vault.namespace = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] vault.root_token_id = **** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] vault.ssl_ca_crt_file = None {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] vault.timeout = 60.0 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] vault.use_ssl = False {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 01:58:44 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] ******************************************************************************** {{(pid=72509) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 21 01:58:44 devstack sudo[72617]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:44 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.573s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:44 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:44 devstack sudo[72623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 01:58:44 devstack sudo[72623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:45 devstack sudo[72623]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:45 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.501s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:45 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 01:58:45 devstack cinder-volume[72613]: INFO cinder.brick.local_dev.lvm [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 21 01:58:45 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:45 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.012s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:45 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:45 devstack sudo[72825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 01:58:45 devstack sudo[72825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:45 devstack sudo[72825]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:45 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.528s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:45 devstack cinder-volume[72613]: DEBUG cinder.brick.local_dev.lvm [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72613) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 21 01:58:45 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:45 devstack sudo[73051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 01:58:45 devstack sudo[73051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:46 devstack sudo[73051]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:46 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.148s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:46 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:46 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:46 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:46 devstack sudo[73258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 01:58:46 devstack sudo[73258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:47 devstack sudo[73258]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:47 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.463s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:47 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:47 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:47 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:47 devstack sudo[73312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 21 01:58:47 devstack sudo[73312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:47 devstack sudo[73312]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:47 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.432s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:47 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:47 devstack sudo[73315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 01:58:47 devstack sudo[73315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:48 devstack sudo[73315]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:48 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:48 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:48 devstack sudo[73351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 01:58:48 devstack sudo[73351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:48 devstack sudo[73351]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:48 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.544s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:48 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:48 devstack sudo[73363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 01:58:48 devstack sudo[73363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:49 devstack sudo[73363]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:49 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:49 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:49 devstack sudo[73371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 01:58:49 devstack sudo[73371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:49 devstack sudo[73371]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:49 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.432s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:49 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:49 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:49 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:49 devstack sudo[73375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 01:58:49 devstack sudo[73375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:50 devstack sudo[73375]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:50 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.451s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:50 devstack cinder-volume[72613]: INFO cinder.volume.drivers.lvm [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 21 01:58:50 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:50 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:50 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:50 devstack sudo[73383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 01:58:50 devstack sudo[73383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:50 devstack sudo[73383]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:50 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.584s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:50 devstack cinder-volume[72613]: DEBUG cinder.volume.drivers.lvm [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Updating volume stats {{(pid=72613) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 01:58:50 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:50 devstack sudo[73500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 01:58:50 devstack sudo[73500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:51 devstack sudo[73500]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:51 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:51 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:51 devstack sudo[73506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 01:58:51 devstack sudo[73506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:51 devstack sudo[73506]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:51 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:51 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:51 devstack sudo[73644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 01:58:51 devstack sudo[73644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:51 devstack sudo[73644]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:51 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.449s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:51 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:51 devstack sudo[73647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 01:58:51 devstack sudo[73647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:52 devstack sudo[73647]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:52 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:52 devstack cinder-volume[72613]: INFO cinder.volume.driver [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Driver hasn't implemented _init_vendor_properties() Apr 21 01:58:52 devstack cinder-volume[72613]: DEBUG cinder.volume.driver [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72613) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 21 01:58:52 devstack cinder-volume[72613]: DEBUG oslo_db.sqlalchemy.engines [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72613) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 01:58:52 devstack cinder-volume[72613]: DEBUG dbcounter [-] [72613] Writer thread running {{(pid=72613) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 01:58:52 devstack cinder-volume[72613]: DEBUG cinder.db.sqlalchemy.api [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Building query based on filter {{(pid=72613) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 21 01:58:52 devstack cinder-volume[72613]: DEBUG cinder.image.image_utils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72613) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 21 01:58:52 devstack cinder-volume[72613]: INFO cinder.keymgr.migration [None req-d87323af-d5b7-496b-a563-7f51d96b1ba9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 21 01:58:52 devstack cinder-volume[72613]: DEBUG cinder.volume.drivers.lvm [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Updating volume stats {{(pid=72613) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 01:58:52 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:52 devstack sudo[73653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 01:58:52 devstack sudo[73653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:52 devstack sudo[73653]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:52 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.415s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:52 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:52 devstack sudo[73659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 01:58:52 devstack sudo[73659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:53 devstack sudo[73659]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:53 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:53 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:53 devstack sudo[73662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 01:58:53 devstack sudo[73662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:53 devstack sudo[73662]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:53 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.420s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:53 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:53 devstack sudo[73667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 01:58:53 devstack sudo[73667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:53 devstack cinder-volume[72509]: DEBUG dbcounter [-] [72509] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72509) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 01:58:54 devstack sudo[73667]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:54 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.420s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:54 devstack cinder-volume[72613]: DEBUG cinder.manager [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Notifying Schedulers of capabilities ... {{(pid=72613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 01:58:54 devstack cinder-volume[72613]: INFO cinder.volume.manager [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Driver initialization completed successfully. Apr 21 01:58:54 devstack cinder-volume[72613]: INFO cinder.manager [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Initiating service 2 cleanup Apr 21 01:58:54 devstack cinder-volume[72613]: INFO cinder.manager [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Service 2 cleanup completed. Apr 21 01:58:54 devstack cinder-volume[72613]: DEBUG cinder.service [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Creating RPC server for service cinder-volume {{(pid=72613) start /opt/stack/cinder/cinder/service.py:231}} Apr 21 01:58:54 devstack cinder-volume[72613]: DEBUG cinder.service [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72613) start /opt/stack/cinder/cinder/service.py:237}} Apr 21 01:58:54 devstack cinder-volume[72613]: INFO cinder.volume.manager [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 21 01:58:54 devstack cinder-volume[72613]: DEBUG cinder.volume.drivers.lvm [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Updating volume stats {{(pid=72613) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 01:58:54 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:54 devstack sudo[73671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 01:58:54 devstack sudo[73671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:54 devstack sudo[73671]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:54 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.535s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:54 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:54 devstack sudo[73680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 01:58:54 devstack sudo[73680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:55 devstack sudo[73680]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:55 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:55 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:55 devstack sudo[73683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 01:58:55 devstack sudo[73683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:55 devstack sudo[73683]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:55 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.411s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:55 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 01:58:55 devstack sudo[73740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 01:58:55 devstack sudo[73740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 01:58:56 devstack sudo[73740]: pam_unix(sudo:session): session closed for user root Apr 21 01:58:56 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.414s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 01:58:56 devstack cinder-volume[72613]: INFO cinder.volume.manager [None req-16d64078-e402-43ae-9789-72b18c938f30 None None] Driver post RPC initialization completed successfully. Apr 21 01:59:06 devstack cinder-volume[72613]: DEBUG dbcounter [-] [72613] Writing DB stats cinder:SELECT=4 {{(pid=72613) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 01:59:06 devstack cinder-volume[72613]: DEBUG dbcounter [-] [72613] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72613) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:00:10 devstack cinder-volume[72613]: DEBUG oslo_service.periodic_task [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 02:00:10 devstack cinder-volume[72613]: DEBUG cinder.volume.drivers.lvm [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] Updating volume stats {{(pid=72613) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 02:00:10 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:00:10 devstack sudo[78587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 02:00:10 devstack sudo[78587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:00:10 devstack sudo[78587]: pam_unix(sudo:session): session closed for user root Apr 21 02:00:10 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:00:10 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:00:10 devstack sudo[78593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 02:00:10 devstack sudo[78593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:00:10 devstack sudo[78593]: pam_unix(sudo:session): session closed for user root Apr 21 02:00:10 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.419s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:00:10 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:00:10 devstack sudo[78599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 02:00:10 devstack sudo[78599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:00:11 devstack sudo[78599]: pam_unix(sudo:session): session closed for user root Apr 21 02:00:11 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.428s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:00:11 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:00:11 devstack sudo[78602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 02:00:11 devstack sudo[78602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:00:11 devstack sudo[78602]: pam_unix(sudo:session): session closed for user root Apr 21 02:00:11 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:00:11 devstack cinder-volume[72613]: DEBUG cinder.manager [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] Notifying Schedulers of capabilities ... {{(pid=72613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:01:06 devstack cinder-volume[72613]: DEBUG dbcounter [-] [72613] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72613) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:01:10 devstack cinder-volume[72613]: DEBUG oslo_service.periodic_task [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72613) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 02:01:10 devstack cinder-volume[72613]: DEBUG cinder.volume.drivers.lvm [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] Updating volume stats {{(pid=72613) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 02:01:10 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:01:10 devstack sudo[80478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 02:01:10 devstack sudo[80478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:01:10 devstack sudo[80478]: pam_unix(sudo:session): session closed for user root Apr 21 02:01:10 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:01:10 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:01:10 devstack sudo[80504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 02:01:10 devstack sudo[80504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:01:10 devstack sudo[80504]: pam_unix(sudo:session): session closed for user root Apr 21 02:01:10 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.423s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:01:10 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:01:10 devstack sudo[80510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 02:01:10 devstack sudo[80510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:01:11 devstack sudo[80510]: pam_unix(sudo:session): session closed for user root Apr 21 02:01:11 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.418s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:01:11 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:01:11 devstack sudo[80514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 02:01:11 devstack sudo[80514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:01:11 devstack sudo[80514]: pam_unix(sudo:session): session closed for user root Apr 21 02:01:11 devstack cinder-volume[72613]: DEBUG oslo_concurrency.processutils [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=72613) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:01:11 devstack cinder-volume[72613]: DEBUG cinder.manager [None req-b051d43a-b9fa-4a86-9a1e-f2616535c262 None None] Notifying Schedulers of capabilities ... {{(pid=72613) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:02:03 devstack cinder-volume[72509]: INFO oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Caught SIGTERM, stopping children Apr 21 02:02:03 devstack cinder-volume[72509]: DEBUG oslo_concurrency.lockutils [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Acquiring lock "singleton_lock" {{(pid=72509) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 02:02:03 devstack cinder-volume[72509]: DEBUG oslo_concurrency.lockutils [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Acquired lock "singleton_lock" {{(pid=72509) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 02:02:03 devstack cinder-volume[72509]: DEBUG oslo_concurrency.lockutils [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Releasing lock "singleton_lock" {{(pid=72509) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 02:02:03 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Stop services. {{(pid=72509) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 21 02:02:03 devstack cinder-volume[72509]: DEBUG oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Killing children. {{(pid=72509) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 21 02:02:03 devstack cinder-volume[72509]: INFO oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Waiting on 1 children to exit Apr 21 02:02:04 devstack cinder-volume[72613]: DEBUG oslo_concurrency.lockutils [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Acquiring lock "singleton_lock" {{(pid=72613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 02:02:04 devstack cinder-volume[72613]: DEBUG oslo_concurrency.lockutils [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Acquired lock "singleton_lock" {{(pid=72613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 02:02:04 devstack cinder-volume[72613]: DEBUG oslo_concurrency.lockutils [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Releasing lock "singleton_lock" {{(pid=72613) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 02:02:04 devstack cinder-volume[72613]: WARNING amqp [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 02:02:04 devstack cinder-volume[72613]: WARNING amqp [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 02:02:04 devstack cinder-volume[72509]: INFO oslo_service.backend._eventlet.service [None req-84c693ac-61a8-4c07-aa7e-bd5bac1bb93a None None] Child 72613 exited with status 0 Apr 21 02:02:04 devstack cinder-volume[81697]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 21 02:02:04 devstack cinder-volume[81697]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 02:02:04 devstack cinder-volume[81697]: we strongly recommend against using it for new projects. Apr 21 02:02:04 devstack cinder-volume[81697]: If you are already using Eventlet, we recommend migrating to a different Apr 21 02:02:04 devstack cinder-volume[81697]: framework. For more detail see Apr 21 02:02:04 devstack cinder-volume[81697]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 02:02:04 devstack cinder-volume[81697]: import eventlet # noqa Apr 21 02:02:06 devstack cinder-volume[81697]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81697) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 02:02:06 devstack cinder-volume[81697]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81697) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 02:02:06 devstack cinder-volume[81697]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81697) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 02:02:06 devstack cinder-volume[81697]: INFO dbcounter [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Registered counter for database cinder Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_db.sqlalchemy.engines [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81697) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG dbcounter [-] [81697] Writer thread running {{(pid=81697) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 02:02:07 devstack cinder-volume[81697]: INFO cinder.rpc [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 21 02:02:07 devstack cinder-volume[81697]: INFO cinder.rpc [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_db.sqlalchemy.engines [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81697) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 02:02:07 devstack cinder-volume[81697]: INFO cinder.volume.manager [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Determined volume DB was empty at startup. Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG cinder.volume.manager [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81697) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 21 02:02:07 devstack cinder-volume[81697]: INFO cinder.volume.manager [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 21 02:02:07 devstack cinder-volume[81697]: WARNING stevedore.named [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 02:02:07 devstack cinder-volume[81697]: WARNING castellan.key_manager [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 02:02:07 devstack cinder-volume[81697]: WARNING cinder.keymgr.conf_key_mgr [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 02:02:07 devstack cinder-volume[81697]: INFO cinder.volume.manager [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_db.sqlalchemy.engines [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81697) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 02:02:07 devstack cinder-volume[81697]: INFO oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Starting 1 workers Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Started child 81816 {{(pid=81697) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Full set of CONF: {{(pid=81697) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] ******************************************************************************** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Configuration options gathered from: {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] ================================================================================ {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] allow_availability_zone_fallback = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] allow_compression_on_image_upload = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] allowed_direct_url_schemes = [] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] api_rate_limit = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] auth_strategy = keystone {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_availability_zone = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_host = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_name = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_stats_polling_interval = 60 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backup_api_class = cinder.backup.api.API {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backup_name_template = backup-%s {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backup_use_same_host = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backup_use_temp_snapshot = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] chap_password = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] chap_username = {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cinder_internal_tenant_project_id = 5a55a393f38c4b868cf6ebca22880392 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cinder_internal_tenant_user_id = 6fb683d985454b8384fddb5a46789ca6 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cluster = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] compression_format = gzip {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] compute_api_class = cinder.compute.nova.API {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] config_dir = [] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] config_source = [] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] control_exchange = openstack {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] debug = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] default_availability_zone = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] default_group_type = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] default_volume_type = QuobyteHD {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] disk_geometry = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] driver_client_cert = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] driver_client_cert_key = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] driver_data_namespace = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] driver_ssl_cert_path = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] driver_ssl_cert_verify = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] driver_use_ssl = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] enable_new_services = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] enable_unsupported_driver = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] enabled_backends = ['QuobyteHD'] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] enforce_multipath_for_image_xfer = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] filter_function = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance_api_insecure = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81816]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance_api_servers = ['http://192.168.122.200/image'] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance_api_ssl_compression = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance_ca_certificates_file = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance_catalog_info = image:glance:publicURL {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance_certfile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance_keyfile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance_num_retries = 3 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance_request_timeout = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] goodness_function = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] graceful_shutdown_timeout = 5 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] group_api_class = cinder.group.api.API {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] host = devstack {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] image_compress_on_upload = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] image_conversion_address_space_limit = 1 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] image_conversion_cpu_limit = 60 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] image_conversion_disable = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] image_upload_use_cinder_backend = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] image_upload_use_internal_tenant = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] image_volume_cache_enabled = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] image_volume_cache_max_count = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] image_volume_cache_max_size_gb = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] init_host_max_objects_retrieval = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] instance_format = [instance: %(uuid)s] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] iscsi_target_flags = {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] iscsi_write_cache = on {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] iser_helper = tgtadm {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] iser_ip_address = 192.168.122.200 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] iser_port = 3260 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] log_color = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] log_config_append = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] log_dir = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] log_file = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] log_options = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] log_rotate_interval = 1 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] log_rotate_interval_type = days {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] log_rotation_type = none {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] max_age = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] max_logfile_count = 30 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] max_logfile_size_mb = 200 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] max_over_subscription_ratio = 20.0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] message_reap_interval = 86400 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] message_ttl = 2592000 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] migration_create_volume_timeout_secs = 300 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] monkey_patch = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] monkey_patch_modules = [] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] my_ip = 192.168.122.200 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] no_snapshot_gb_quota = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] num_iser_scan_tries = 3 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] num_shell_tries = 3 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] num_volume_device_scan_tries = 3 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] nvmeof_conn_info_version = 1 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] nvmet_ns_id = 10 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] nvmet_port_id = 1 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] osapi_max_limit = 1000 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] osapi_volume_ext_list = [] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] osapi_volume_listen_port = 8776 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] osapi_volume_use_ssl = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] osapi_volume_workers = 2 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] per_volume_size_limit = -1 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] periodic_fuzzy_delay = 60 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] periodic_interval = 60 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] public_endpoint = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] publish_errors = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] quota_backup_gigabytes = 1000 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] quota_backups = 10 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] quota_gigabytes = 1000 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] quota_groups = 10 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] quota_snapshots = 10 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] quota_volumes = 10 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] rate_limit_burst = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] rate_limit_except_level = CRITICAL {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] rate_limit_interval = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] reinit_driver_count = 3 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] replication_device = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] report_discard_supported = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] report_interval = 120 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] reservation_clean_interval = 86400 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] reservation_expire = 86400 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] reserved_image_namespaces = [] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] reserved_percentage = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81816]: INFO cinder.volume.manager [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Starting volume driver QuobyteDriver (1.1.14) Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81816]: DEBUG cinder.volume.drivers.remotefs [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81816) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] rpc_response_timeout = 120 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] run_external_periodic_tasks = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] scst_target_driver = iscsi {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] scst_target_iqn_name = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] service_down_time = 720 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] shell_completion = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] snapshot_name_template = snapshot-%s {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] split_loggers = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] state_path = /opt/stack/data/cinder {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] storage_availability_zone = nova {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] storage_protocol = iSCSI {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] syslog_log_facility = LOG_USER {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] target_helper = lioadm {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] target_ip_address = 192.168.122.200 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] target_port = 3260 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] target_protocol = iscsi {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] target_secondary_ip_addresses = [] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] trace_flags = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] transport_url = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] until_refresh = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] use_chap_auth = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] use_default_quota_class = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] use_journal = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] use_json = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] use_multipath_for_image_xfer = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] use_stderr = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] use_syslog = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] verify_glance_signatures = enabled {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] volume_api_class = cinder.volume.api.API {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] volume_backend_name = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] volume_clear = zero {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] volume_clear_ionice = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] volume_clear_size = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] volume_copy_bps_limit = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] volume_dd_blocksize = 1M {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] volume_name_template = volume-%s {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] volume_service_inithost_offload = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] volume_usage_audit_period = month {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] zoning_mode = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_concurrency.disable_process_locking = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.admin_password = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.admin_token = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.admin_user = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.auth_port = 35357 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.auth_protocol = https {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.auth_section = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.auth_type = password {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.auth_uri = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.auth_version = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.cache = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.certfile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.identity_uri = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.include_service_catalog = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.insecure = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.interface = public {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.keyfile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.memcache_password = {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.memcache_username = {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.region_name = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.service_type = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.200/identity {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.backend = dogpile.cache.null {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.backend_argument = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.backend_expiration_time = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.config_prefix = cache.oslo {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.debug_cache_backend = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.enable_retry_client = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.enable_socket_keepalive = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.enabled = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.enforce_fips_mode = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.expiration_time = 600 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.hashclient_retry_attempts = 2 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.memcache_dead_retry = 300 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.memcache_pool_maxsize = 10 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.memcache_sasl_enabled = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.password = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.proxies = [] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.redis_db = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.redis_server = localhost:6379 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.retry_attempts = 2 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.retry_delay = 0.0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.socket_keepalive_count = 1 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.socket_keepalive_idle = 1 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.socket_keepalive_interval = 1 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.socket_timeout = 1.0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.tls_allowed_ciphers = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.tls_cafile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.tls_certfile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.tls_enabled = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.tls_keyfile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cache.username = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] coordination.backend_url = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.asyncio_connection = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.asyncio_slave_connection = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.backend = sqlalchemy {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.connection = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.connection_debug = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.connection_parameters = {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.connection_recycle_time = 3600 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.connection_trace = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.db_inc_retry_interval = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.db_max_retries = 20 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.db_max_retry_interval = 10 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.db_retry_interval = 1 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.max_overflow = 50 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.max_pool_size = 5 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.max_retries = 10 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.mysql_wsrep_sync_wait = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.pool_timeout = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.retry_interval = 10 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.slave_connection = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.sqlite_synchronous = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.synchronous_reader = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] database.use_db_reconnect = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] profiler.connection_string = messaging:// {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] profiler.enabled = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] profiler.es_doc_type = notification {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] profiler.es_scroll_size = 10000 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] profiler.es_scroll_time = 2m {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] profiler.filter_error_trace = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] profiler.hmac_keys = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] profiler.sentinel_service_name = mymaster {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] profiler.socket_timeout = 0.1 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] profiler.trace_requests = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] profiler.trace_sqlalchemy = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] profiler_jaeger.process_tags = {} {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] profiler_jaeger.service_name_prefix = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] profiler_otlp.service_name_prefix = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_policy.enforce_new_defaults = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: WARNING oslo_config.cfg [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_policy.enforce_scope = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_policy.policy_default_rule = default {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_policy.policy_file = policy.yaml {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] privsep_osbrick.group = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] privsep_osbrick.helper_command = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81816]: DEBUG cinder.volume.drivers.quobyte [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81816) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] privsep_osbrick.user = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cinder_sys_admin.group = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81816]: WARNING cinder.volume.drivers.quobyte [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cinder_sys_admin.helper_command = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81816]: WARNING cinder.volume.drivers.quobyte [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] cinder_sys_admin.user = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] service_user.auth_section = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81816]: DEBUG oslo_concurrency.processutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Running cmd (subprocess): mount.quobyte {{(pid=81816) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] service_user.auth_type = password {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] service_user.cafile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] service_user.certfile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] service_user.collect_timing = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] service_user.insecure = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] service_user.keyfile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] service_user.send_service_user_token = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] service_user.split_loggers = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] service_user.timeout = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance.auth_section = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance.auth_type = password {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance.certfile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance.collect_timing = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance.insecure = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance.keyfile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance.region_name = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance.split_loggers = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] glance.timeout = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.backend_availability_zone = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.chap_password = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.chap_username = {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.disk_geometry = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.driver_client_cert = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.driver_client_cert_key = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.driver_data_namespace = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.driver_use_ssl = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.extra_capabilities = {} {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.filter_function = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.goodness_function = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.iscsi_target_flags = {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.iscsi_write_cache = on {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.iser_helper = tgtadm {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.iser_ip_address = 192.168.122.200 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.iser_port = 3260 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.nas_host = {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.nas_login = admin {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.nas_mount_options = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.nas_password = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.nas_private_key = {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.nas_share_path = {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.num_shell_tries = 3 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.quobyte_volume_url = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.replication_device = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.report_discard_supported = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.reserved_percentage = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.target_helper = tgtadm {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.target_ip_address = 192.168.122.200 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.target_port = 3260 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.target_protocol = iscsi {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.trace_flags = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.unique_fqdn_network = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.use_chap_auth = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.volume_backend_name = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.volume_clear = zero {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.volume_clear_ionice = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.volume_clear_size = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_reports.file_event_handler = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_reports.log_dir = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.backend_availability_zone = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.backend_host = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.chap_password = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.chap_username = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.chiscsi_conf = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.disk_geometry = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.driver_client_cert = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.driver_data_namespace = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.driver_use_ssl = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.extra_capabilities = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.filter_function = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.goodness_function = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.iser_helper = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.iser_ip_address = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.iser_port = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.iser_target_prefix = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.nas_host = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.nas_login = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.nas_mount_options = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.nas_password = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.nas_private_key = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.nas_share_path = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.nas_ssh_port = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.num_shell_tries = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.nvmet_port_id = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.replication_device = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.report_discard_supported = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.reserved_percentage = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.scst_target_driver = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.storage_protocol = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.target_helper = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.target_ip_address = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.target_port = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.target_prefix = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.target_protocol = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.trace_flags = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.use_chap_auth = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.volume_clear = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.volume_clear_size = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] QuobyteHD.volumes_dir = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.ssl = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_notifications.driver = [] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_notifications.retry = -1 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] key_manager.fixed_key = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican.barbican_api_version = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican.barbican_endpoint = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican.barbican_endpoint_type = public {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican.barbican_region_name = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican.cafile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican.certfile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican.collect_timing = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican.insecure = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican.keyfile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican.number_of_retries = 60 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican.retry_delay = 1 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican.send_service_user_token = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican.split_loggers = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican.timeout = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican.verify_ssl = True {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican.verify_ssl_path = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican_service_user.auth_section = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican_service_user.auth_type = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican_service_user.cafile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican_service_user.certfile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican_service_user.collect_timing = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack quobyte-client[81820]: Reading configuration file: /etc/quobyte/client.cfg Apr 21 02:02:07 devstack quobyte-client[81820]: Invalid parameters found, error: missing mount point. Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican_service_user.insecure = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican_service_user.keyfile = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack quobyte-client[81820]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 21 02:02:07 devstack quobyte-client[81820]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican_service_user.split_loggers = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] barbican_service_user.timeout = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] vault.approle_role_id = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] vault.approle_secret_id = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] vault.kv_mountpoint = secret {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] vault.kv_path = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] vault.kv_version = 2 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] vault.namespace = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] vault.root_token_id = **** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] vault.ssl_ca_crt_file = None {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] vault.timeout = 60.0 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] vault.use_ssl = False {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:07 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] ******************************************************************************** {{(pid=81697) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 21 02:02:07 devstack cinder-volume[81816]: DEBUG oslo_concurrency.processutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=81816) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:02:07 devstack cinder-volume[81816]: DEBUG oslo_concurrency.lockutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81816) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:02:07 devstack cinder-volume[81816]: DEBUG oslo_concurrency.lockutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81816) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:02:07 devstack cinder-volume[81816]: DEBUG cinder.volume.drivers.quobyte [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=81816) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:02:07 devstack cinder-volume[81816]: INFO cinder.volume.drivers.quobyte [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b ... Apr 21 02:02:07 devstack cinder-volume[81816]: DEBUG oslo_concurrency.processutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 -c /etc/quobyte/client-cinder.cfg {{(pid=81816) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:02:07 devstack sudo[81821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 -c /etc/quobyte/client-cinder.cfg Apr 21 02:02:07 devstack sudo[81821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:02:08 devstack sudo[81821]: pam_unix(sudo:session): session closed for user root Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG oslo_concurrency.processutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.508s {{(pid=81816) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:02:08 devstack cinder-volume[81816]: INFO cinder.volume.drivers.quobyte [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b succeeded Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG cinder.volume.drivers.quobyte [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=81816) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG oslo_concurrency.lockutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.514s {{(pid=81816) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG oslo_concurrency.processutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=81816) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:02:08 devstack sudo[81890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:02:08 devstack sudo[81890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:02:08 devstack sudo[81890]: pam_unix(sudo:session): session closed for user root Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG oslo_concurrency.processutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.401s {{(pid=81816) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:02:08 devstack cinder-volume[81816]: INFO cinder.volume.driver [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Driver hasn't implemented _init_vendor_properties() Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG cinder.volume.driver [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81816) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG oslo_db.sqlalchemy.engines [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81816) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG dbcounter [-] [81816] Writer thread running {{(pid=81816) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG cinder.db.sqlalchemy.api [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Building query based on filter {{(pid=81816) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG cinder.image.image_utils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81816) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 21 02:02:08 devstack cinder-volume[81816]: INFO cinder.keymgr.migration [None req-8de81794-1a16-46f8-8e2b-2c9ec222ee04 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG oslo_concurrency.lockutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81816) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG oslo_concurrency.lockutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81816) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG cinder.volume.drivers.quobyte [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=81816) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG cinder.volume.drivers.quobyte [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=81816) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG oslo_concurrency.lockutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81816) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG oslo_concurrency.processutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=81816) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:02:08 devstack sudo[81893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:02:08 devstack sudo[81893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:02:08 devstack sudo[81893]: pam_unix(sudo:session): session closed for user root Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG oslo_concurrency.processutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.398s {{(pid=81816) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG cinder.manager [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Notifying Schedulers of capabilities ... {{(pid=81816) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:02:08 devstack cinder-volume[81816]: INFO cinder.volume.manager [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Driver initialization completed successfully. Apr 21 02:02:08 devstack cinder-volume[81816]: INFO cinder.manager [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Initiating service 3 cleanup Apr 21 02:02:08 devstack cinder-volume[81816]: INFO cinder.manager [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Service 3 cleanup completed. Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG cinder.service [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Creating RPC server for service cinder-volume {{(pid=81816) start /opt/stack/cinder/cinder/service.py:231}} Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG cinder.service [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81816) start /opt/stack/cinder/cinder/service.py:237}} Apr 21 02:02:08 devstack cinder-volume[81816]: INFO cinder.volume.manager [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG oslo_concurrency.lockutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81816) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG oslo_concurrency.lockutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81816) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:02:08 devstack cinder-volume[81816]: DEBUG cinder.volume.drivers.quobyte [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=81816) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:02:09 devstack cinder-volume[81816]: DEBUG cinder.volume.drivers.quobyte [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=81816) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:02:09 devstack cinder-volume[81816]: DEBUG oslo_concurrency.lockutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81816) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:02:09 devstack cinder-volume[81816]: DEBUG oslo_concurrency.processutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=81816) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:02:09 devstack sudo[81898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:02:09 devstack sudo[81898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:02:09 devstack sudo[81898]: pam_unix(sudo:session): session closed for user root Apr 21 02:02:09 devstack cinder-volume[81816]: DEBUG oslo_concurrency.processutils [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.396s {{(pid=81816) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:02:09 devstack cinder-volume[81816]: INFO cinder.volume.manager [None req-4db0a412-c9d1-4b50-a28e-fe9fb95eebcc None None] Driver post RPC initialization completed successfully. Apr 21 02:02:11 devstack cinder-volume[81697]: INFO oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Caught SIGTERM, stopping children Apr 21 02:02:11 devstack cinder-volume[81697]: DEBUG oslo_concurrency.lockutils [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Acquiring lock "singleton_lock" {{(pid=81697) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 02:02:11 devstack cinder-volume[81697]: DEBUG oslo_concurrency.lockutils [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Acquired lock "singleton_lock" {{(pid=81697) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 02:02:11 devstack cinder-volume[81697]: DEBUG oslo_concurrency.lockutils [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Releasing lock "singleton_lock" {{(pid=81697) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 02:02:11 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Stop services. {{(pid=81697) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 21 02:02:11 devstack cinder-volume[81697]: DEBUG oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Killing children. {{(pid=81697) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 21 02:02:11 devstack cinder-volume[81697]: INFO oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Waiting on 1 children to exit Apr 21 02:02:13 devstack cinder-volume[81816]: DEBUG oslo_concurrency.lockutils [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Acquiring lock "singleton_lock" {{(pid=81816) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 02:02:13 devstack cinder-volume[81816]: DEBUG oslo_concurrency.lockutils [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Acquired lock "singleton_lock" {{(pid=81816) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 02:02:13 devstack cinder-volume[81816]: DEBUG oslo_concurrency.lockutils [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Releasing lock "singleton_lock" {{(pid=81816) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 02:02:13 devstack cinder-volume[81816]: WARNING amqp [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 02:02:13 devstack cinder-volume[81816]: WARNING amqp [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 02:02:13 devstack cinder-volume[81697]: INFO oslo_service.backend._eventlet.service [None req-d253782b-b559-4ca6-bd5a-df06a3571594 None None] Child 81816 exited with status 0 Apr 21 02:02:13 devstack cinder-volume[82045]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 21 02:02:13 devstack cinder-volume[82045]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 02:02:13 devstack cinder-volume[82045]: we strongly recommend against using it for new projects. Apr 21 02:02:13 devstack cinder-volume[82045]: If you are already using Eventlet, we recommend migrating to a different Apr 21 02:02:13 devstack cinder-volume[82045]: framework. For more detail see Apr 21 02:02:13 devstack cinder-volume[82045]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 02:02:13 devstack cinder-volume[82045]: import eventlet # noqa Apr 21 02:02:14 devstack cinder-volume[82045]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 02:02:14 devstack cinder-volume[82045]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 02:02:14 devstack cinder-volume[82045]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82045) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 02:02:15 devstack cinder-volume[82045]: INFO dbcounter [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] Registered counter for database cinder Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_db.sqlalchemy.engines [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82045) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG dbcounter [-] [82045] Writer thread running {{(pid=82045) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 02:02:15 devstack cinder-volume[82045]: INFO cinder.rpc [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 21 02:02:15 devstack cinder-volume[82045]: INFO cinder.rpc [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_db.sqlalchemy.engines [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82045) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 02:02:15 devstack cinder-volume[82045]: INFO cinder.volume.manager [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] Determined volume DB was empty at startup. Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG cinder.volume.manager [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82045) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 21 02:02:15 devstack cinder-volume[82045]: WARNING stevedore.named [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 02:02:15 devstack cinder-volume[82045]: WARNING castellan.key_manager [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 02:02:15 devstack cinder-volume[82045]: WARNING cinder.keymgr.conf_key_mgr [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 02:02:15 devstack cinder-volume[82045]: INFO cinder.volume.manager [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_db.sqlalchemy.engines [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82045) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 02:02:15 devstack cinder-volume[82045]: INFO oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] Starting 1 workers Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] Started child 82184 {{(pid=82045) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] Full set of CONF: {{(pid=82045) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] ******************************************************************************** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] Configuration options gathered from: {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] ================================================================================ {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] allow_availability_zone_fallback = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] allow_compression_on_image_upload = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] allowed_direct_url_schemes = [] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] api_rate_limit = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] auth_strategy = keystone {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_availability_zone = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_host = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_name = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_stats_polling_interval = 60 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backup_api_class = cinder.backup.api.API {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backup_name_template = backup-%s {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backup_use_same_host = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backup_use_temp_snapshot = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] chap_password = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] chap_username = {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cinder_internal_tenant_project_id = 5a55a393f38c4b868cf6ebca22880392 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cinder_internal_tenant_user_id = 6fb683d985454b8384fddb5a46789ca6 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cluster = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82184]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] compression_format = gzip {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] compute_api_class = cinder.compute.nova.API {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] config_dir = [] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] config_source = [] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] control_exchange = openstack {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] debug = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] default_availability_zone = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] default_group_type = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] default_volume_type = QuobyteHD {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] disk_geometry = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] driver_client_cert = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] driver_client_cert_key = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] driver_data_namespace = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] driver_ssl_cert_path = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] driver_ssl_cert_verify = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] driver_use_ssl = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] enable_new_services = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] enable_unsupported_driver = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] enabled_backends = ['QuobyteHD'] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] enforce_multipath_for_image_xfer = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] filter_function = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance_api_insecure = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance_api_servers = ['http://192.168.122.200/image'] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance_api_ssl_compression = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance_ca_certificates_file = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance_catalog_info = image:glance:publicURL {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance_certfile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance_keyfile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance_num_retries = 3 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance_request_timeout = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] goodness_function = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] graceful_shutdown_timeout = 5 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] group_api_class = cinder.group.api.API {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] host = devstack {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] image_compress_on_upload = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] image_conversion_address_space_limit = 1 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] image_conversion_cpu_limit = 60 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] image_conversion_disable = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] image_upload_use_cinder_backend = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] image_upload_use_internal_tenant = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] image_volume_cache_enabled = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] image_volume_cache_max_count = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] image_volume_cache_max_size_gb = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] init_host_max_objects_retrieval = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] instance_format = [instance: %(uuid)s] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] iscsi_target_flags = {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] iscsi_write_cache = on {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 21 02:02:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82184) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] iser_helper = tgtadm {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] iser_ip_address = 192.168.122.200 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] iser_port = 3260 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] log_color = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] log_config_append = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] log_dir = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] log_file = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] log_options = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] log_rotate_interval = 1 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] log_rotate_interval_type = days {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] log_rotation_type = none {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] max_age = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] max_logfile_count = 30 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] max_logfile_size_mb = 200 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] max_over_subscription_ratio = 20.0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] message_reap_interval = 86400 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] message_ttl = 2592000 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] migration_create_volume_timeout_secs = 300 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] monkey_patch = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] monkey_patch_modules = [] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] my_ip = 192.168.122.200 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] no_snapshot_gb_quota = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] num_iser_scan_tries = 3 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] num_shell_tries = 3 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] num_volume_device_scan_tries = 3 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] nvmeof_conn_info_version = 1 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] nvmet_ns_id = 10 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] nvmet_port_id = 1 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] osapi_max_limit = 1000 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] osapi_volume_ext_list = [] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] osapi_volume_listen_port = 8776 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] osapi_volume_use_ssl = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] osapi_volume_workers = 2 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] per_volume_size_limit = -1 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] periodic_fuzzy_delay = 60 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] periodic_interval = 60 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] public_endpoint = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] publish_errors = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] quota_backup_gigabytes = 1000 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] quota_backups = 10 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] quota_gigabytes = 1000 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] quota_groups = 10 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] quota_snapshots = 10 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] quota_volumes = 10 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] rate_limit_burst = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] rate_limit_except_level = CRITICAL {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] rate_limit_interval = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] reinit_driver_count = 3 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] replication_device = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] report_discard_supported = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] report_interval = 120 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] reservation_clean_interval = 86400 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] reservation_expire = 86400 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] reserved_image_namespaces = [] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] reserved_percentage = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] rpc_response_timeout = 120 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] run_external_periodic_tasks = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] scst_target_driver = iscsi {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] scst_target_iqn_name = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] service_down_time = 720 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] shell_completion = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] snapshot_name_template = snapshot-%s {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] split_loggers = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] state_path = /opt/stack/data/cinder {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] storage_availability_zone = nova {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] storage_protocol = iSCSI {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] syslog_log_facility = LOG_USER {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] target_helper = lioadm {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] target_ip_address = 192.168.122.200 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] target_port = 3260 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] target_protocol = iscsi {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] target_secondary_ip_addresses = [] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] trace_flags = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] transport_url = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] until_refresh = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] use_chap_auth = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] use_default_quota_class = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] use_journal = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] use_json = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] use_multipath_for_image_xfer = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] use_stderr = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] use_syslog = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] verify_glance_signatures = enabled {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] volume_api_class = cinder.volume.api.API {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] volume_backend_name = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] volume_clear = zero {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] volume_clear_ionice = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] volume_clear_size = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] volume_copy_bps_limit = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] volume_dd_blocksize = 1M {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] volume_name_template = volume-%s {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] volume_service_inithost_offload = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] volume_usage_audit_period = month {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] zoning_mode = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_concurrency.disable_process_locking = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.admin_password = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.admin_token = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.admin_user = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.auth_port = 35357 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.auth_protocol = https {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.auth_section = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.auth_type = password {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.auth_uri = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.auth_version = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.cache = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.certfile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.identity_uri = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.include_service_catalog = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.insecure = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.interface = public {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.keyfile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.memcache_password = {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.memcache_username = {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.region_name = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.service_type = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.200/identity {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.backend = dogpile.cache.null {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.backend_argument = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.backend_expiration_time = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.config_prefix = cache.oslo {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.debug_cache_backend = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.enable_retry_client = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.enable_socket_keepalive = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.enabled = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.enforce_fips_mode = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.expiration_time = 600 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82184) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.hashclient_retry_attempts = 2 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.memcache_dead_retry = 300 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.quobyte [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.quobyte [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.memcache_pool_maxsize = 10 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.memcache_sasl_enabled = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.password = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.proxies = [] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.redis_db = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Running cmd (subprocess): mount.quobyte {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.redis_server = localhost:6379 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.retry_attempts = 2 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.retry_delay = 0.0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.socket_keepalive_count = 1 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.socket_keepalive_idle = 1 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.socket_keepalive_interval = 1 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.socket_timeout = 1.0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.tls_allowed_ciphers = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.tls_cafile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.tls_certfile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.tls_enabled = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.tls_keyfile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cache.username = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] coordination.backend_url = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.asyncio_connection = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.asyncio_slave_connection = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.backend = sqlalchemy {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.connection = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.connection_debug = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.connection_parameters = {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.connection_recycle_time = 3600 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.connection_trace = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.db_inc_retry_interval = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.db_max_retries = 20 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.db_max_retry_interval = 10 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.db_retry_interval = 1 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.max_overflow = 50 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.max_pool_size = 5 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.max_retries = 10 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.mysql_wsrep_sync_wait = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.pool_timeout = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.retry_interval = 10 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.slave_connection = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.sqlite_synchronous = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.synchronous_reader = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] database.use_db_reconnect = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] profiler.connection_string = messaging:// {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] profiler.enabled = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] profiler.es_doc_type = notification {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] profiler.es_scroll_size = 10000 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] profiler.es_scroll_time = 2m {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] profiler.filter_error_trace = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] profiler.hmac_keys = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] profiler.sentinel_service_name = mymaster {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] profiler.socket_timeout = 0.1 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] profiler.trace_requests = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] profiler.trace_sqlalchemy = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] profiler_jaeger.process_tags = {} {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] profiler_jaeger.service_name_prefix = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] profiler_otlp.service_name_prefix = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_policy.enforce_new_defaults = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: WARNING oslo_config.cfg [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_policy.enforce_scope = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_policy.policy_default_rule = default {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_policy.policy_file = policy.yaml {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] privsep_osbrick.group = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] privsep_osbrick.helper_command = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:15 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] privsep_osbrick.user = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cinder_sys_admin.group = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cinder_sys_admin.helper_command = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] cinder_sys_admin.user = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] service_user.auth_section = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] service_user.auth_type = password {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] service_user.cafile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] service_user.certfile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] service_user.collect_timing = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] service_user.insecure = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] service_user.keyfile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] service_user.send_service_user_token = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] service_user.split_loggers = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] service_user.timeout = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance.auth_section = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance.auth_type = password {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance.certfile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance.collect_timing = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance.insecure = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance.keyfile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance.region_name = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance.split_loggers = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] glance.timeout = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.backend_availability_zone = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.chap_password = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.chap_username = {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.disk_geometry = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.driver_client_cert = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.driver_client_cert_key = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.driver_data_namespace = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.driver_use_ssl = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.extra_capabilities = {} {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.filter_function = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.goodness_function = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.iscsi_target_flags = {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.iscsi_write_cache = on {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.iser_helper = tgtadm {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack quobyte-client[82199]: Reading configuration file: /etc/quobyte/client.cfg Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.iser_ip_address = 192.168.122.200 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.iser_port = 3260 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.nas_host = {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.nas_login = admin {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack quobyte-client[82199]: Invalid parameters found, error: missing mount point. Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.nas_mount_options = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.nas_password = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.nas_private_key = {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack quobyte-client[82199]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] CMD "mount.quobyte" returned: 1 in 0.101s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:02:16 devstack quobyte-client[82199]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.nas_share_path = {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.num_shell_tries = 3 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.quobyte_volume_url = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.replication_device = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.report_discard_supported = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.reserved_percentage = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.target_helper = tgtadm {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.target_ip_address = 192.168.122.200 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.target_port = 3260 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.target_protocol = iscsi {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.trace_flags = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.unique_fqdn_network = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.use_chap_auth = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack sudo[82228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.volume_backend_name = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.volume_clear = zero {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.volume_clear_ionice = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.volume_clear_size = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack sudo[82228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_reports.file_event_handler = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_reports.log_dir = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.backend_availability_zone = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.backend_host = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.chap_password = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.chap_username = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.chiscsi_conf = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.disk_geometry = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.driver_client_cert = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.driver_data_namespace = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.driver_use_ssl = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.extra_capabilities = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.filter_function = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.goodness_function = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.iser_helper = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.iser_ip_address = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.iser_port = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.iser_target_prefix = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.nas_host = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.nas_login = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.nas_mount_options = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.nas_password = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.nas_private_key = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.nas_share_path = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.nas_ssh_port = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.num_shell_tries = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.nvmet_port_id = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.replication_device = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.report_discard_supported = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.reserved_percentage = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.scst_target_driver = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.storage_protocol = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.target_helper = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.target_ip_address = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.target_port = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.target_prefix = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.target_protocol = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.trace_flags = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.use_chap_auth = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.volume_clear = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.volume_clear_size = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] QuobyteHD.volumes_dir = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.ssl = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_notifications.driver = [] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_notifications.retry = -1 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] key_manager.fixed_key = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican.barbican_api_version = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican.barbican_endpoint = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican.barbican_endpoint_type = public {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican.barbican_region_name = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican.cafile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican.certfile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican.collect_timing = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican.insecure = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican.keyfile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican.number_of_retries = 60 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican.retry_delay = 1 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican.send_service_user_token = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican.split_loggers = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican.timeout = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican.verify_ssl = True {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican.verify_ssl_path = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican_service_user.auth_section = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican_service_user.auth_type = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican_service_user.cafile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican_service_user.certfile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican_service_user.collect_timing = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican_service_user.insecure = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican_service_user.keyfile = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican_service_user.split_loggers = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] barbican_service_user.timeout = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] vault.approle_role_id = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] vault.approle_secret_id = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] vault.kv_mountpoint = secret {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] vault.kv_path = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] vault.kv_version = 2 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] vault.namespace = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] vault.root_token_id = **** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] vault.ssl_ca_crt_file = None {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] vault.timeout = 60.0 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] vault.use_ssl = False {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 02:02:16 devstack cinder-volume[82045]: DEBUG oslo_service.backend._eventlet.service [None req-4965ddb8-ae25-46fc-b21b-e6d4949fb7f1 None None] ******************************************************************************** {{(pid=82045) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 21 02:02:16 devstack sudo[82228]: pam_unix(sudo:session): session closed for user root Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.682s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:02:16 devstack cinder-volume[82184]: INFO cinder.volume.driver [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Driver hasn't implemented _init_vendor_properties() Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG cinder.volume.driver [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82184) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG oslo_db.sqlalchemy.engines [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82184) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writer thread running {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG cinder.db.sqlalchemy.api [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Building query based on filter {{(pid=82184) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82184) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:02:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:02:16 devstack cinder-volume[82184]: INFO cinder.keymgr.migration [None req-8243be45-6e0f-47f7-969a-3dbb071c1347 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 21 02:02:16 devstack sudo[82277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:02:16 devstack sudo[82277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:02:17 devstack sudo[82277]: pam_unix(sudo:session): session closed for user root Apr 21 02:02:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.401s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:02:17 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:02:17 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Driver initialization completed successfully. Apr 21 02:02:17 devstack cinder-volume[82184]: INFO cinder.manager [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Initiating service 3 cleanup Apr 21 02:02:17 devstack cinder-volume[82184]: INFO cinder.manager [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Service 3 cleanup completed. Apr 21 02:02:17 devstack cinder-volume[82184]: DEBUG cinder.service [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Creating RPC server for service cinder-volume {{(pid=82184) start /opt/stack/cinder/cinder/service.py:231}} Apr 21 02:02:17 devstack cinder-volume[82184]: DEBUG cinder.service [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82184) start /opt/stack/cinder/cinder/service.py:237}} Apr 21 02:02:17 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 21 02:02:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:02:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:02:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:02:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:02:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:02:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:02:17 devstack sudo[82288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:02:17 devstack sudo[82288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:02:17 devstack sudo[82288]: pam_unix(sudo:session): session closed for user root Apr 21 02:02:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.420s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:02:17 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-a482cb3d-03ac-4f85-acf3-4560329d3380 None None] Driver post RPC initialization completed successfully. Apr 21 02:02:25 devstack cinder-volume[82045]: DEBUG dbcounter [-] [82045] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82045) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:02:27 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:02:27 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:SELECT=3 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:03:11 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e67e8a05-73ad-4b36-bedb-47c3da913aaa tempest-BackendsCapabilitiesAdminTestsJSON-56879452 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82184) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 21 02:03:11 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f93a707a-2611-4a09-853c-3ead540c2737 tempest-BackendsCapabilitiesAdminTestsJSON-56879452 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82184) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Flow 'volume_create_manager' (2f66fdba-0a25-4e0f-8718-79e80dabc0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f5dae7-886a-456a-8f89-d801ae8efe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f5dae7-886a-456a-8f89-d801ae8efe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1254801555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b99b3149-df94-44d8-9698-2f39bd8d12fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8cc938368364c2287effa5d5d8e6f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:03:15Z,use_quota=True,user_id='dc18a658c87a46be961eff2086bea3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1455be63-70c6-4578-b7fe-f89bb3586631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1455be63-70c6-4578-b7fe-f89bb3586631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb8fc91-aa8f-45aa-81f5-d0af59024b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb8fc91-aa8f-45aa-81f5-d0af59024b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b99b3149-df94-44d8-9698-2f39bd8d12fd', 'volume_name': 'volume-b99b3149-df94-44d8-9698-2f39bd8d12fd', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d82787-3dc2-4a6c-a7f6-395ef92b2777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d82787-3dc2-4a6c-a7f6-395ef92b2777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4a4d69-1a6f-49b2-96fa-f8a94796282d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:15 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Volume b99b3149-df94-44d8-9698-2f39bd8d12fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b99b3149-df94-44d8-9698-2f39bd8d12fd', 'volume_size': 1} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1254801555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b99b3149-df94-44d8-9698-2f39bd8d12fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8cc938368364c2287effa5d5d8e6f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:03:15Z,use_quota=True,user_id='dc18a658c87a46be961eff2086bea3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Creating volume b99b3149-df94-44d8-9698-2f39bd8d12fd {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:03:15 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b99b3149-df94-44d8-9698-2f39bd8d12fd 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:15 devstack sudo[82673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b99b3149-df94-44d8-9698-2f39bd8d12fd 1073741824 Apr 21 02:03:15 devstack sudo[82673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Flow 'volume_create_manager' (044ed3b2-3fe6-41cc-a05f-41ddb1b046d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52d1141-a1c4-4302-a8e3-45420b6c2966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52d1141-a1c4-4302-a8e3-45420b6c2966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1214470191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2517de6-ab4e-4ac7-b7cf-309b1c2588f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bf7d5a940204ed1b7c486203c42e1fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:03:15Z,use_quota=True,user_id='260a6fcbbdc74c75b0ac39197b31116f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f457da4a-e352-4017-b0c0-e2b435133510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f457da4a-e352-4017-b0c0-e2b435133510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ed56f2-5e9b-49b1-805b-4e4da48387ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ed56f2-5e9b-49b1-805b-4e4da48387ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2517de6-ab4e-4ac7-b7cf-309b1c2588f1', 'volume_name': 'volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2969c302-d824-432f-8abf-33345a91740f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2969c302-d824-432f-8abf-33345a91740f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb439daa-2869-4804-98ac-f1bb427dae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:15 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Volume f2517de6-ab4e-4ac7-b7cf-309b1c2588f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1', 'volume_size': 1} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Flow 'volume_create_manager' (c3a807cb-7528-4239-bf46-614f3becc811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d488780-02f1-4f73-a244-228f2b33de1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d488780-02f1-4f73-a244-228f2b33de1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-550725546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3730c54ffef647e5a627f1b90b00975d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:03:16Z,use_quota=True,user_id='bef505e3a8834d31a25b89938a6f43e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c425d634-8b70-4a49-a514-cd67bfa55675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c425d634-8b70-4a49-a514-cd67bfa55675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99288ef-0529-424c-bbd0-701e52181c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99288ef-0529-424c-bbd0-701e52181c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc', 'volume_name': 'volume-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9273172d-e635-4d3d-95ed-b5f42777b213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9273172d-e635-4d3d-95ed-b5f42777b213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25c82ce-d6d3-450f-8206-6430c1f16acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:15 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Volume 2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc', 'volume_size': 1} Apr 21 02:03:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:15 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-97546a61-15f2-4848-a7c0-40e5a3aa78f2 tempest-GroupSnapshotsTest-2104303601 None] Group tempest-GroupSnapshotsTest-Group-1816200499: creating Apr 21 02:03:15 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-97546a61-15f2-4848-a7c0-40e5a3aa78f2 tempest-GroupSnapshotsTest-2104303601 None] Group tempest-GroupSnapshotsTest-Group-1816200499: created successfully Apr 21 02:03:15 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-97546a61-15f2-4848-a7c0-40e5a3aa78f2 tempest-GroupSnapshotsTest-2104303601 None] Create group completed successfully. Apr 21 02:03:16 devstack sudo[82673]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b99b3149-df94-44d8-9698-2f39bd8d12fd 1073741824" returned: 0 in 0.971s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b99b3149-df94-44d8-9698-2f39bd8d12fd {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:16 devstack sudo[83005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b99b3149-df94-44d8-9698-2f39bd8d12fd Apr 21 02:03:16 devstack sudo[83005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:16 devstack sudo[83005]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b99b3149-df94-44d8-9698-2f39bd8d12fd" returned: 0 in 0.415s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.120s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1214470191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2517de6-ab4e-4ac7-b7cf-309b1c2588f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bf7d5a940204ed1b7c486203c42e1fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:03:15Z,use_quota=True,user_id='260a6fcbbdc74c75b0ac39197b31116f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Creating volume f2517de6-ab4e-4ac7-b7cf-309b1c2588f1 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:03:16 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4a4d69-1a6f-49b2-96fa-f8a94796282d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b99b3149-df94-44d8-9698-2f39bd8d12fd', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:16 devstack sudo[83009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1 1073741824 Apr 21 02:03:16 devstack sudo[83009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba360092-4cb6-4f75-a929-0fed897029e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:16 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Volume volume-b99b3149-df94-44d8-9698-2f39bd8d12fd (b99b3149-df94-44d8-9698-2f39bd8d12fd): created successfully Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba360092-4cb6-4f75-a929-0fed897029e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Flow 'volume_create_manager' (2f66fdba-0a25-4e0f-8718-79e80dabc0ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:03:16 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-f2c65bfd-4d11-4579-bd1d-44001cea21dd tempest-VolumesAdminNegativeTest-313734536 None] Created volume successfully. Apr 21 02:03:17 devstack sudo[83009]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1 1073741824" returned: 0 in 0.507s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:17 devstack sudo[83014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1 Apr 21 02:03:17 devstack sudo[83014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Flow 'volume_create_manager' (14d52149-9639-4c4a-a31a-e70a32e2c761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e440a3b-5946-4ed7-b422-ef5a49c9d66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e440a3b-5946-4ed7-b422-ef5a49c9d66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1400879058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c9ee83fd-b8ce-45b8-b870-fc3b83720bff,host='devstack@QuobyteHD#QuobyteHD',id=1930f694-3df7-4f55-a259-19aacb596ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8180f8cab9147eeacef8ad23cd672c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:03:17Z,use_quota=True,user_id='e31da291e81c4392a2e8e552bfab70f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17e2e2ba-dbc2-40e5-b257-ca754b3db00e),volume_type_id=17e2e2ba-dbc2-40e5-b257-ca754b3db00e)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d682e2-7058-4ea4-8b9c-775d520933ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d682e2-7058-4ea4-8b9c-775d520933ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b0009a-eb09-4e8c-9ecc-054b9a18439c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b0009a-eb09-4e8c-9ecc-054b9a18439c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1930f694-3df7-4f55-a259-19aacb596ad3', 'volume_name': 'volume-1930f694-3df7-4f55-a259-19aacb596ad3', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bab1e32-42a5-4890-9226-3c0320b21e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bab1e32-42a5-4890-9226-3c0320b21e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bd62c0-5f38-4ecc-a8a1-428c3ee29553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:17 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Volume 1930f694-3df7-4f55-a259-19aacb596ad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1930f694-3df7-4f55-a259-19aacb596ad3', 'volume_size': 1} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:17 devstack sudo[83014]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1" returned: 0 in 0.560s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.105s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-550725546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3730c54ffef647e5a627f1b90b00975d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:03:16Z,use_quota=True,user_id='bef505e3a8834d31a25b89938a6f43e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Creating volume 2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:03:17 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:17 devstack sudo[83018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc 1073741824 Apr 21 02:03:17 devstack sudo[83018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb439daa-2869-4804-98ac-f1bb427dae1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c432825-a89d-4f6e-a120-ee56483d3b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:17 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Volume volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1 (f2517de6-ab4e-4ac7-b7cf-309b1c2588f1): created successfully Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c432825-a89d-4f6e-a120-ee56483d3b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Flow 'volume_create_manager' (044ed3b2-3fe6-41cc-a05f-41ddb1b046d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Acquiring lock "cinder-b99b3149-df94-44d8-9698-2f39bd8d12fd-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:17 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-c45b86d1-6fe5-4183-af7d-8f2c069360eb tempest-DeleteServersTestJSON-1397650295 None] Created volume successfully. Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Lock "cinder-b99b3149-df94-44d8-9698-2f39bd8d12fd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Acquiring lock "cinder-quobyte-b99b3149-df94-44d8-9698-2f39bd8d12fd" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Lock "cinder-quobyte-b99b3149-df94-44d8-9698-2f39bd8d12fd" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:17 devstack cinder-volume[82184]: INFO oslo.privsep.daemon [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp39rhty3f/privsep.sock'] Apr 21 02:03:17 devstack sudo[83021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp39rhty3f/privsep.sock Apr 21 02:03:17 devstack sudo[83021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:18 devstack sudo[83018]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc 1073741824" returned: 0 in 0.601s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:18 devstack cinder-volume[82184]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 21 02:03:18 devstack cinder-volume[82184]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 02:03:18 devstack cinder-volume[82184]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 21 02:03:18 devstack cinder-volume[82184]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 02:03:18 devstack cinder-volume[82184]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 21 02:03:18 devstack cinder-volume[82184]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 21 02:03:18 devstack cinder-volume[82184]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 02:03:18 devstack cinder-volume[82184]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 02:03:18 devstack cinder-volume[82184]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 21 02:03:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:18 devstack sudo[83034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc Apr 21 02:03:18 devstack sudo[83034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:18 devstack cinder-volume[82184]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 21 02:03:18 devstack cinder-volume[82184]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 02:03:18 devstack cinder-volume[82184]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 21 02:03:18 devstack cinder-volume[82184]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 02:03:18 devstack cinder-volume[82184]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 21 02:03:18 devstack cinder-volume[82184]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 21 02:03:18 devstack cinder-volume[82184]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 02:03:18 devstack cinder-volume[82184]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 02:03:18 devstack cinder-volume[82184]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 21 02:03:18 devstack sudo[83034]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc" returned: 0 in 0.428s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:03:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.481s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c9ee83fd-b8ce-45b8-b870-fc3b83720bff,created_at=2026-04-21T00:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1400879058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c9ee83fd-b8ce-45b8-b870-fc3b83720bff,host='devstack@QuobyteHD#QuobyteHD',id=1930f694-3df7-4f55-a259-19aacb596ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8180f8cab9147eeacef8ad23cd672c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:03:17Z,use_quota=True,user_id='e31da291e81c4392a2e8e552bfab70f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17e2e2ba-dbc2-40e5-b257-ca754b3db00e),volume_type_id=17e2e2ba-dbc2-40e5-b257-ca754b3db00e)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:03:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Creating volume 1930f694-3df7-4f55-a259-19aacb596ad3 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:03:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:03:18 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:03:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25c82ce-d6d3-450f-8206-6430c1f16acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bfa639-f96f-407e-803a-e256ff20f46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:18 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Volume volume-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc (2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc): created successfully Apr 21 02:03:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bfa639-f96f-407e-803a-e256ff20f46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:18 devstack sudo[83039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 1073741824 Apr 21 02:03:19 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Flow 'volume_create_manager' (c3a807cb-7528-4239-bf46-614f3becc811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:03:19 devstack sudo[83039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:19 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-0b15e5c5-8fba-4e99-baa2-3d10105bbbd2 tempest-VolumeQuotasAdminTestJSON-498805306 None] Created volume successfully. Apr 21 02:03:19 devstack sudo[83021]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:19 devstack cinder-volume[82184]: INFO oslo.privsep.daemon [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Spawned new privsep daemon via rootwrap Apr 21 02:03:19 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Accepted privsep connection to /tmp/tmp39rhty3f/privsep.sock {{(pid=82184) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 21 02:03:19 devstack cinder-volume[82184]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 21 02:03:19 devstack cinder-volume[82184]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 21 02:03:19 devstack cinder-volume[82184]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 21 02:03:19 devstack cinder-volume[82184]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83041 Apr 21 02:03:19 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3071df9a-4b57-4051-b15f-c4817ae181f4]: (2,) {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:19 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4768e9fa-5a9d-4917-8474-c11c1757df10]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b99b3149-df94-44d8-9698-2f39bd8d12fd {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:19 devstack sudo[83043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b99b3149-df94-44d8-9698-2f39bd8d12fd Apr 21 02:03:19 devstack sudo[83043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:19 devstack sudo[83039]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 1073741824" returned: 0 in 0.695s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:19 devstack sudo[83049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 Apr 21 02:03:19 devstack sudo[83049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] Acquiring lock "cinder-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] Lock "cinder-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] Acquiring lock "cinder-quobyte-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] Lock "cinder-quobyte-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:19 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7e7495-6000-456b-9040-4e3c2d64ceb3]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:19 devstack sudo[83051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc Apr 21 02:03:19 devstack sudo[83051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:20 devstack sudo[83043]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b99b3149-df94-44d8-9698-2f39bd8d12fd" returned: 0 in 0.773s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b99b3149-df94-44d8-9698-2f39bd8d12fd {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:20 devstack sudo[83056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b99b3149-df94-44d8-9698-2f39bd8d12fd Apr 21 02:03:20 devstack sudo[83056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:20 devstack sudo[83051]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc" returned: 0 in 0.528s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:20 devstack sudo[83049]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3" returned: 0 in 0.768s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:20 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:03:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:20 devstack sudo[83062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc Apr 21 02:03:20 devstack sudo[83062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bd62c0-5f38-4ecc-a8a1-428c3ee29553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1930f694-3df7-4f55-a259-19aacb596ad3', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c18eb82-cd1f-4991-9e92-bc3d70bcc177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:20 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Volume volume-1930f694-3df7-4f55-a259-19aacb596ad3 (1930f694-3df7-4f55-a259-19aacb596ad3): created successfully Apr 21 02:03:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c18eb82-cd1f-4991-9e92-bc3d70bcc177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Flow 'volume_create_manager' (14d52149-9639-4c4a-a31a-e70a32e2c761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:03:20 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-2614ac71-693a-461d-aafe-26c8f605ff47 tempest-GroupSnapshotsTest-2104303601 None] Created volume successfully. Apr 21 02:03:21 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] GroupSnapshot a9902796-ef40-4731-89df-ff0b2df6a20f: creating. Apr 21 02:03:21 devstack sudo[83056]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] Group snapshot a9902796-ef40-4731-89df-ff0b2df6a20f: creating. {{(pid=82184) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b99b3149-df94-44d8-9698-2f39bd8d12fd" returned: 0 in 1.001s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] Creating offline snapshot b6fad97d-c32c-4393-bed2-a98d475f2076 of volume 1930f694-3df7-4f55-a259-19aacb596ad3 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Lock "cinder-quobyte-b99b3149-df94-44d8-9698-2f39bd8d12fd" released by "delete_volume" :: held 3.190s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2936983-890b-499e-a44d-4b9cc28a05cd]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:21 devstack cinder-volume[82184]: WARNING cinder.quota [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:03:21 devstack cinder-volume[82184]: WARNING cinder.quota [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:03:21 devstack sudo[83062]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc" returned: 0 in 0.835s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Created reservations ['77b11a09-5029-4951-9d19-b4463d28630d', '0c7eb39f-efa2-45a1-a479-a5053f3c4629', '37eed242-dcf6-4422-a6b4-0869ef9e4412', 'cc75864f-bbe4-49ce-94df-4deb7fe21d4b'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:03:21 devstack sudo[83068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 Apr 21 02:03:21 devstack sudo[83068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] Lock "cinder-quobyte-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc" released by "delete_volume" :: held 1.410s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:21 devstack sudo[83071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:03:21 devstack sudo[83071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] Created reservations ['9b34f661-ca8c-45ef-8d72-2c59534b2212', '6972579c-653d-414d-9498-905413334264', '6c51e6f2-186d-43cb-b78f-3d13b6449da1', '86910517-0e4d-45ec-9770-d953db2018c9'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:21 devstack sudo[83076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:03:21 devstack sudo[83076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:22 devstack sudo[83068]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3" returned: 0 in 0.990s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:22 devstack sudo[83083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076 1G Apr 21 02:03:22 devstack sudo[83083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:22 devstack sudo[83071]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.961s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:03:22 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Deleted volume successfully. Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c6ba7254-1baa-43f4-b924-4f05f892d2c9 tempest-VolumesAdminNegativeTest-313734536 None] Lock "cinder-b99b3149-df94-44d8-9698-2f39bd8d12fd-delete_volume" released by "delete_volume" :: held 4.470s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:22 devstack sudo[83076]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 1.022s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:03:22 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] Deleted volume successfully. Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-60d826f6-94a0-4fef-810d-3d8b20888604 tempest-VolumeQuotasAdminTestJSON-498805306 None] Lock "cinder-2a42019f-4d4f-4af1-a5b3-ae93e7e5eabc-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Flow 'volume_create_manager' (4db61b39-9a73-458a-8c79-060ddcfd6dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4307951f-096a-4aab-a067-2b389c329396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4307951f-096a-4aab-a067-2b389c329396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-240536398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a6a77d-ca98-4ff0-8931-7949386979ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3730c54ffef647e5a627f1b90b00975d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:03:23Z,use_quota=True,user_id='bef505e3a8834d31a25b89938a6f43e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f47c052-7034-4fdc-9dd5-6fb8229003c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f47c052-7034-4fdc-9dd5-6fb8229003c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b49c256-02c8-4a83-ada7-dd6fb2aea1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b49c256-02c8-4a83-ada7-dd6fb2aea1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60a6a77d-ca98-4ff0-8931-7949386979ab', 'volume_name': 'volume-60a6a77d-ca98-4ff0-8931-7949386979ab', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff48041-c099-490c-ab10-17355b9fa87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff48041-c099-490c-ab10-17355b9fa87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7618a0f6-704e-4fcf-956d-d090d03a02c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:22 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Volume 60a6a77d-ca98-4ff0-8931-7949386979ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60a6a77d-ca98-4ff0-8931-7949386979ab', 'volume_size': 1} Apr 21 02:03:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:23 devstack sudo[83083]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076 1G" returned: 0 in 0.974s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1930f694-3df7-4f55-a259-19aacb596ad3 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:23 devstack sudo[83091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1930f694-3df7-4f55-a259-19aacb596ad3 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076 Apr 21 02:03:23 devstack sudo[83091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:23 devstack sudo[83091]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1930f694-3df7-4f55-a259-19aacb596ad3 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076" returned: 0 in 0.463s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:23 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 02:03:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:23 devstack sudo[83106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076 Apr 21 02:03:23 devstack sudo[83106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:23 devstack cinder-volume[82184]: WARNING py.warnings [req-b81c851f-0de4-444f-a1d9-dfcd400dfbac req-5a6e34ce-fc12-4c14-a034-394251ef2f78 tempest-DeleteServersTestJSON-1397650295 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 21 02:03:23 devstack cinder-volume[82184]: .first() Apr 21 02:03:23 devstack cinder-volume[82184]: Apr 21 02:03:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-b81c851f-0de4-444f-a1d9-dfcd400dfbac req-5a6e34ce-fc12-4c14-a034-394251ef2f78 tempest-DeleteServersTestJSON-1397650295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:24 devstack sudo[83106]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076" returned: 0 in 0.479s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:24 devstack sudo[83134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.info Apr 21 02:03:24 devstack sudo[83134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:24 devstack sudo[83134]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.info" returned: 0 in 0.545s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:24 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 02:03:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:24 devstack sudo[83145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.info Apr 21 02:03:24 devstack sudo[83145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:25 devstack sudo[83145]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.info" returned: 0 in 0.468s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.087s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.173s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-240536398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a6a77d-ca98-4ff0-8931-7949386979ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3730c54ffef647e5a627f1b90b00975d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:03:23Z,use_quota=True,user_id='bef505e3a8834d31a25b89938a6f43e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:03:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Creating volume 60a6a77d-ca98-4ff0-8931-7949386979ab {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:03:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:03:25 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:03:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-60a6a77d-ca98-4ff0-8931-7949386979ab 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:25 devstack sudo[83152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-60a6a77d-ca98-4ff0-8931-7949386979ab 1073741824 Apr 21 02:03:25 devstack sudo[83152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:25 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-300a00ed-2a68-4f97-9c4c-184bd4d89af0 tempest-GroupSnapshotsTest-2104303601 None] group_snapshot a9902796-ef40-4731-89df-ff0b2df6a20f: created successfully Apr 21 02:03:25 devstack sudo[83152]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-60a6a77d-ca98-4ff0-8931-7949386979ab 1073741824" returned: 0 in 0.593s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-60a6a77d-ca98-4ff0-8931-7949386979ab {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:25 devstack sudo[83159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-60a6a77d-ca98-4ff0-8931-7949386979ab Apr 21 02:03:25 devstack sudo[83159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:26 devstack sudo[83159]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-60a6a77d-ca98-4ff0-8931-7949386979ab" returned: 0 in 0.407s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-b81c851f-0de4-444f-a1d9-dfcd400dfbac req-5a6e34ce-fc12-4c14-a034-394251ef2f78 tempest-DeleteServersTestJSON-1397650295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.492s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7618a0f6-704e-4fcf-956d-d090d03a02c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60a6a77d-ca98-4ff0-8931-7949386979ab', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f148a7e-db0f-4b5e-aa31-05bf38f87c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[850e1eb8-8b10-49ae-b387-1962b6567c4c]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-b81c851f-0de4-444f-a1d9-dfcd400dfbac req-5a6e34ce-fc12-4c14-a034-394251ef2f78 tempest-DeleteServersTestJSON-1397650295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:26 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Volume volume-60a6a77d-ca98-4ff0-8931-7949386979ab (60a6a77d-ca98-4ff0-8931-7949386979ab): created successfully Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f148a7e-db0f-4b5e-aa31-05bf38f87c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Flow 'volume_create_manager' (4db61b39-9a73-458a-8c79-060ddcfd6dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:03:26 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-3cad1980-cfa7-4df9-9316-6ec2f5821bf8 tempest-VolumeQuotasAdminTestJSON-498805306 None] Created volume successfully. Apr 21 02:03:26 devstack sudo[83163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1 Apr 21 02:03:26 devstack sudo[83163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:26 devstack sudo[83163]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-b81c851f-0de4-444f-a1d9-dfcd400dfbac req-5a6e34ce-fc12-4c14-a034-394251ef2f78 tempest-DeleteServersTestJSON-1397650295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1" returned: 0 in 0.541s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-b81c851f-0de4-444f-a1d9-dfcd400dfbac req-5a6e34ce-fc12-4c14-a034-394251ef2f78 tempest-DeleteServersTestJSON-1397650295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.559s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.387s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "cinder-quobyte-b6fad97d-c32c-4393-bed2-a98d475f2076-89272615-3302-490c-915b-884c5a1276ed" by "_create_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-b6fad97d-c32c-4393-bed2-a98d475f2076-89272615-3302-490c-915b-884c5a1276ed" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Creating volume 89272615-3302-490c-915b-884c5a1276ed from snapshot b6fad97d-c32c-4393-bed2-a98d475f2076 {{(pid=82184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "cinder-quobyte-89272615-3302-490c-915b-884c5a1276ed" by "_copy_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-b81c851f-0de4-444f-a1d9-dfcd400dfbac req-5a6e34ce-fc12-4c14-a034-394251ef2f78 tempest-DeleteServersTestJSON-1397650295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b', 'name': 'volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4015a43-db1f-4ab0-924c-cbcaeb0d96cc', 'enforce_multipath': True} {{(pid=82184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-89272615-3302-490c-915b-884c5a1276ed" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] snapshot: b6fad97d-c32c-4393-bed2-a98d475f2076, volume: 89272615-3302-490c-915b-884c5a1276ed, {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88fcada-729e-4830-a163-2bebfe438925]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:26 devstack cinder-volume[82184]: INFO cinder.volume.manager [req-b81c851f-0de4-444f-a1d9-dfcd400dfbac req-5a6e34ce-fc12-4c14-a034-394251ef2f78 tempest-DeleteServersTestJSON-1397650295 None] attachment_update completed successfully. Apr 21 02:03:26 devstack sudo[83168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076 Apr 21 02:03:26 devstack sudo[83168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:27 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-d9994ac8-dcf7-4824-a685-7df517b8bd1e tempest-VolumeQuotasAdminTestJSON-801357378 None] Transfer volume completed successfully. Apr 21 02:03:27 devstack sudo[83168]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076" returned: 0 in 0.539s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1930f694-3df7-4f55-a259-19aacb596ad3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:03:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 02:03:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Creating direct copy from snapshot {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 02:03:27 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf9fd97-bd4b-4dfa-bfc8-5f4a82a52eda]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:27 devstack sudo[83182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 Apr 21 02:03:27 devstack sudo[83182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:27 devstack sudo[83182]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3" returned: 0 in 0.571s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:27 devstack cinder-volume[82184]: DEBUG cinder.utils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Path /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-89272615-3302-490c-915b-884c5a1276ed not found in is_blk_device check {{(pid=82184) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 02:03:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-89272615-3302-490c-915b-884c5a1276ed {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:28 devstack sudo[83255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-89272615-3302-490c-915b-884c5a1276ed Apr 21 02:03:28 devstack sudo[83255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:28 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] Acquiring lock "cinder-60a6a77d-ca98-4ff0-8931-7949386979ab-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:28 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] Lock "cinder-60a6a77d-ca98-4ff0-8931-7949386979ab-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:28 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] Acquiring lock "cinder-quobyte-60a6a77d-ca98-4ff0-8931-7949386979ab" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:28 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] Lock "cinder-quobyte-60a6a77d-ca98-4ff0-8931-7949386979ab" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:28 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b78189-2d66-4b32-9e1a-de6973e15abe]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-60a6a77d-ca98-4ff0-8931-7949386979ab {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:28 devstack sudo[83573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-60a6a77d-ca98-4ff0-8931-7949386979ab Apr 21 02:03:28 devstack sudo[83573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:29 devstack sudo[83573]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-60a6a77d-ca98-4ff0-8931-7949386979ab" returned: 0 in 1.173s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-60a6a77d-ca98-4ff0-8931-7949386979ab {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:29 devstack sudo[83603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-60a6a77d-ca98-4ff0-8931-7949386979ab Apr 21 02:03:29 devstack sudo[83603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:30 devstack sudo[83603]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-60a6a77d-ca98-4ff0-8931-7949386979ab" returned: 0 in 1.405s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:30 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] Lock "cinder-quobyte-60a6a77d-ca98-4ff0-8931-7949386979ab" released by "delete_volume" :: held 2.612s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:30 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] Created reservations ['848130fd-c0ce-4139-b7a5-6231fdf731c0', 'ce134ccd-abdf-4b2e-885e-b7c3c9b8e28a', '4558b508-772b-4c9c-88b6-867db11562c5', 'ad3f459b-aaa5-46a7-8770-a963666d1f8d'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:03:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:31 devstack sudo[83606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:03:31 devstack sudo[83606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:31 devstack sudo[83255]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-89272615-3302-490c-915b-884c5a1276ed" returned: 0 in 3.072s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:31 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fea23d5-8707-4578-abcd-c56772e9d18d]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:31 devstack sudo[83608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 Apr 21 02:03:31 devstack sudo[83608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:31 devstack sudo[83606]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.479s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:31 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:03:31 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] Deleted volume successfully. Apr 21 02:03:31 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1ad8c780-21fa-4eea-9cac-813eaca2cfff tempest-VolumeQuotasAdminTestJSON-504302293 None] Lock "cinder-60a6a77d-ca98-4ff0-8931-7949386979ab-delete_volume" released by "delete_volume" :: held 3.384s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:31 devstack sudo[83608]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3" returned: 0 in 0.699s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:31 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Image conversion details: src /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3, size 1024.00 MB, duration 3.07 sec, destination /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-89272615-3302-490c-915b-884c5a1276ed {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:03:31 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Converted 1024.00 MB image at 333.25 MB/s Apr 21 02:03:31 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-89272615-3302-490c-915b-884c5a1276ed is being set with open permissions: ugo+rw: NotImplementedError Apr 21 02:03:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-89272615-3302-490c-915b-884c5a1276ed {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:31 devstack sudo[83614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-89272615-3302-490c-915b-884c5a1276ed Apr 21 02:03:31 devstack sudo[83614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:32 devstack sudo[83614]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-89272615-3302-490c-915b-884c5a1276ed" returned: 0 in 0.568s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:32 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-89272615-3302-490c-915b-884c5a1276ed" released by "_copy_volume_from_snapshot" :: held 5.533s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:32 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-b6fad97d-c32c-4393-bed2-a98d475f2076-89272615-3302-490c-915b-884c5a1276ed" released by "_create_volume_from_snapshot" :: held 5.570s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.596s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:32 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-52680f20-394a-44e9-9c37-80424e1f379b tempest-GroupSnapshotsTest-2104303601 None] Create group from source-snapshot-a9902796-ef40-4731-89df-ff0b2df6a20f completed successfully. Apr 21 02:03:32 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "cinder-quobyte-89272615-3302-490c-915b-884c5a1276ed" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:32 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-89272615-3302-490c-915b-884c5a1276ed" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:32 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4db2984-ed93-45ac-85a9-9c48069562aa]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-89272615-3302-490c-915b-884c5a1276ed {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:33 devstack sudo[83621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-89272615-3302-490c-915b-884c5a1276ed Apr 21 02:03:33 devstack sudo[83621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:33 devstack sudo[83621]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-89272615-3302-490c-915b-884c5a1276ed" returned: 0 in 0.736s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-89272615-3302-490c-915b-884c5a1276ed {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:33 devstack sudo[83656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-89272615-3302-490c-915b-884c5a1276ed Apr 21 02:03:33 devstack sudo[83656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:34 devstack sudo[83656]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-89272615-3302-490c-915b-884c5a1276ed" returned: 0 in 0.610s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:34 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-89272615-3302-490c-915b-884c5a1276ed" released by "delete_volume" :: held 1.387s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:34 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] Created reservations ['c0fa410f-38a7-434c-a3ed-e13b1a84c35e'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:03:34 devstack cinder-volume[82184]: WARNING cinder.quota [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1505832070 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1505832070, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:03:34 devstack cinder-volume[82184]: WARNING cinder.quota [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1505832070 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1505832070, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:03:34 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] Created reservations ['580b77a0-c89f-4083-8740-16c6431eaff8', 'd06f8fac-5835-4fec-81af-89f1b216e1b9', '5ee9e9ab-9171-428f-80e3-002f32b1c6d2', '28f85c2e-e9a9-4b35-8bf1-466a1b68893d'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:03:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:34 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:34 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:34 devstack sudo[83686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:03:34 devstack sudo[83686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:34 devstack sudo[83686]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.460s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:34 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:03:34 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-54e566b8-8509-41d3-abc6-7c8129d53249 tempest-GroupSnapshotsTest-2104303601 None] Delete group completed successfully. Apr 21 02:03:35 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] group_snapshot a9902796-ef40-4731-89df-ff0b2df6a20f: deleting Apr 21 02:03:35 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] group_snapshot a9902796-ef40-4731-89df-ff0b2df6a20f: deleting {{(pid=82184) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 02:03:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "cinder-quobyte-1930f694-3df7-4f55-a259-19aacb596ad3" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-1930f694-3df7-4f55-a259-19aacb596ad3" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "cinder-quobyte-b6fad97d-c32c-4393-bed2-a98d475f2076" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-b6fad97d-c32c-4393-bed2-a98d475f2076" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] Deleting offline snapshot b6fad97d-c32c-4393-bed2-a98d475f2076 of volume 1930f694-3df7-4f55-a259-19aacb596ad3 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:03:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] snapshot_file for this snap is: volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:03:35 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[914906c4-f9df-4be6-b08e-83430b77dda0]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:35 devstack sudo[83694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076 Apr 21 02:03:35 devstack sudo[83694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:35 devstack sudo[83694]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076" returned: 0 in 0.629s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1930f694-3df7-4f55-a259-19aacb596ad3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:03:36 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[00054fec-b835-46e5-8f8f-9c76d97bd44f]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:36 devstack sudo[83700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 Apr 21 02:03:36 devstack sudo[83700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:36 devstack cinder-volume[82184]: INFO cinder.volume.manager [req-aaec24e5-103c-42e9-8a67-e275cb5e0a47 req-bd3e5608-22e8-42a2-8c3e-d48b0de773b1 tempest-DeleteServersTestJSON-1397650295 None] Terminate volume connection completed successfully. Apr 21 02:03:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-aaec24e5-103c-42e9-8a67-e275cb5e0a47 req-bd3e5608-22e8-42a2-8c3e-d48b0de773b1 tempest-DeleteServersTestJSON-1397650295 None] Deleting attachment b4015a43-db1f-4ab0-924c-cbcaeb0d96cc. {{(pid=82184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 21 02:03:36 devstack sudo[83700]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3" returned: 0 in 0.652s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:36 devstack sudo[83705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076 Apr 21 02:03:36 devstack sudo[83705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:37 devstack sudo[83705]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076" returned: 0 in 0.578s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:37 devstack sudo[83711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076 Apr 21 02:03:37 devstack sudo[83711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Flow 'volume_create_manager' (221e81c1-e1d2-420f-b3c8-7acac5676984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88427f84-61cc-496a-af8f-c8673018c47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88427f84-61cc-496a-af8f-c8673018c47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1393274865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4380fed4-61fa-4a91-8c01-713ec4609dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33597fd9070d4e09bba346c719874eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:03:37Z,use_quota=True,user_id='eb5e3f78bdf24949a4d34c23e4bcdcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2784f469-83b4-44ac-908b-fe0386620c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2784f469-83b4-44ac-908b-fe0386620c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94504f5-802e-4a61-b136-621c523ac92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94504f5-802e-4a61-b136-621c523ac92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4380fed4-61fa-4a91-8c01-713ec4609dbb', 'volume_name': 'volume-4380fed4-61fa-4a91-8c01-713ec4609dbb', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc016a3-7da3-4931-a2c9-d86b67ac4196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc016a3-7da3-4931-a2c9-d86b67ac4196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e79cde8-6b95-4fa8-b3cb-64f2e05cbefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:37 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Volume 4380fed4-61fa-4a91-8c01-713ec4609dbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4380fed4-61fa-4a91-8c01-713ec4609dbb', 'volume_size': 1} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1393274865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4380fed4-61fa-4a91-8c01-713ec4609dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33597fd9070d4e09bba346c719874eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:03:37Z,use_quota=True,user_id='eb5e3f78bdf24949a4d34c23e4bcdcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Creating volume 4380fed4-61fa-4a91-8c01-713ec4609dbb {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:03:37 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4380fed4-61fa-4a91-8c01-713ec4609dbb 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:37 devstack sudo[83713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4380fed4-61fa-4a91-8c01-713ec4609dbb 1073741824 Apr 21 02:03:37 devstack sudo[83713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:37 devstack sudo[83711]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3.b6fad97d-c32c-4393-bed2-a98d475f2076" returned: 0 in 0.541s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-b6fad97d-c32c-4393-bed2-a98d475f2076" released by "_delete_snapshot" :: held 2.450s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-1930f694-3df7-4f55-a259-19aacb596ad3" released by "delete_snapshot" :: held 2.469s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:37 devstack cinder-volume[82184]: WARNING cinder.quota [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1505832070 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1505832070, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:03:37 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] Created reservations ['f928c13b-2ed6-45a1-ae96-625b97375cbe', '8c0f1e2a-8ce6-4c6c-90c3-fc6ad95ae9c4', '7a36682c-c092-4426-905c-e15406eee85a', 'aafe1bef-0e11-47a8-9553-183561e3f78c'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:03:37 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-6036e08b-744c-42e7-a8e4-e2e4f59752ee tempest-GroupSnapshotsTest-2104303601 None] group_snapshot a9902796-ef40-4731-89df-ff0b2df6a20f: deleted successfully Apr 21 02:03:37 devstack sudo[83713]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4380fed4-61fa-4a91-8c01-713ec4609dbb 1073741824" returned: 0 in 0.499s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4380fed4-61fa-4a91-8c01-713ec4609dbb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:38 devstack sudo[83719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4380fed4-61fa-4a91-8c01-713ec4609dbb Apr 21 02:03:38 devstack sudo[83719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:38 devstack sudo[83719]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4380fed4-61fa-4a91-8c01-713ec4609dbb" returned: 0 in 0.457s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e79cde8-6b95-4fa8-b3cb-64f2e05cbefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4380fed4-61fa-4a91-8c01-713ec4609dbb', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a9b32e-8d26-43e2-adf1-64904e6c7778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:38 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Volume volume-4380fed4-61fa-4a91-8c01-713ec4609dbb (4380fed4-61fa-4a91-8c01-713ec4609dbb): created successfully Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a9b32e-8d26-43e2-adf1-64904e6c7778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Flow 'volume_create_manager' (221e81c1-e1d2-420f-b3c8-7acac5676984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:03:38 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b42f7fea-d203-45cd-9621-0826b2a1f5f2 tempest-VolumeQuotasNegativeTestJSON-180399006 None] Created volume successfully. Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "cinder-quobyte-1930f694-3df7-4f55-a259-19aacb596ad3" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-1930f694-3df7-4f55-a259-19aacb596ad3" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG oslo_service.periodic_task [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f751d1-7064-4448-b13c-3293664fef95]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:38 devstack sudo[83723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:03:38 devstack sudo[83723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:38 devstack sudo[83725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 Apr 21 02:03:38 devstack sudo[83725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:39 devstack sudo[83723]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.427s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:39 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:03:39 devstack sudo[83725]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3" returned: 0 in 0.601s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:39 devstack sudo[83732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3 Apr 21 02:03:39 devstack sudo[83732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:39 devstack sudo[83732]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1930f694-3df7-4f55-a259-19aacb596ad3" returned: 0 in 0.533s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:39 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-1930f694-3df7-4f55-a259-19aacb596ad3" released by "delete_volume" :: held 1.179s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] Created reservations ['8126a01d-8c14-4fe7-8005-84fb3ada4654'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:03:40 devstack cinder-volume[82184]: WARNING cinder.db.sqlalchemy.api [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1505832070'] Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] Created reservations ['c8546043-b4bb-4fb1-9ba0-ea423b3c66da', 'bfcc6dd8-fe30-4b3e-a965-e90645da26e1', '88872542-2fd6-4e61-992c-d682dda3afd8', 'c183b30b-03d3-4c0f-a580-88cc11c7d9cb'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] Acquiring lock "cinder-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] Lock "cinder-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:40 devstack sudo[83736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:03:40 devstack sudo[83736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] Acquiring lock "cinder-quobyte-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] Lock "cinder-quobyte-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10be345-8f57-4521-b44a-c623c80296df]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:40 devstack sudo[83738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1 Apr 21 02:03:40 devstack sudo[83738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] Acquiring lock "cinder-4380fed4-61fa-4a91-8c01-713ec4609dbb-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] Lock "cinder-4380fed4-61fa-4a91-8c01-713ec4609dbb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] Acquiring lock "cinder-quobyte-4380fed4-61fa-4a91-8c01-713ec4609dbb" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] Lock "cinder-quobyte-4380fed4-61fa-4a91-8c01-713ec4609dbb" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d644bd-abde-4e46-b30e-2a669c8d1a53]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4380fed4-61fa-4a91-8c01-713ec4609dbb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:40 devstack sudo[83740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4380fed4-61fa-4a91-8c01-713ec4609dbb Apr 21 02:03:40 devstack sudo[83740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:40 devstack sudo[83736]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.502s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:03:40 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-5c90fc28-7660-44d7-8184-9958b38cb94e tempest-GroupSnapshotsTest-2104303601 None] Delete group completed successfully. Apr 21 02:03:40 devstack sudo[83738]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1" returned: 0 in 0.648s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:40 devstack sudo[83747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1 Apr 21 02:03:40 devstack sudo[83747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:40 devstack sudo[83740]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4380fed4-61fa-4a91-8c01-713ec4609dbb" returned: 0 in 0.611s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4380fed4-61fa-4a91-8c01-713ec4609dbb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:41 devstack sudo[83751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4380fed4-61fa-4a91-8c01-713ec4609dbb Apr 21 02:03:41 devstack sudo[83751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:41 devstack sudo[83747]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1" returned: 0 in 0.452s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] Lock "cinder-quobyte-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1" released by "delete_volume" :: held 1.121s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] Created reservations ['72a6b2d0-a48b-4549-beb3-eab8266a4c86', '17576af9-e0d7-4a0a-b2d6-67cf7a834581', '52cd3e9a-4f05-4e52-a330-fc6c0c16536f', '9da1516e-01f1-4203-9575-6ad9b13b57ef'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:41 devstack sudo[83754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:03:41 devstack sudo[83754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:41 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-3e98aeeb-4e6d-458f-b622-48d0011c6d80 tempest-GroupSnapshotsTest-2104303601 None] Group tempest-GroupSnapshotsTest-Group-1455542743: creating Apr 21 02:03:41 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-3e98aeeb-4e6d-458f-b622-48d0011c6d80 tempest-GroupSnapshotsTest-2104303601 None] Group tempest-GroupSnapshotsTest-Group-1455542743: created successfully Apr 21 02:03:41 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-3e98aeeb-4e6d-458f-b622-48d0011c6d80 tempest-GroupSnapshotsTest-2104303601 None] Create group completed successfully. Apr 21 02:03:41 devstack sudo[83751]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4380fed4-61fa-4a91-8c01-713ec4609dbb" returned: 0 in 0.600s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] Lock "cinder-quobyte-4380fed4-61fa-4a91-8c01-713ec4609dbb" released by "delete_volume" :: held 1.233s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] Created reservations ['dda4f8a7-423e-49a8-aae4-36333bb8d861', '36baaff8-8739-4da6-afe1-c0b9a4e5d248', 'f3b8755c-cc72-48fd-8dbf-f7f49350cd58', '0ca21bc5-be10-4346-9de0-b5cb26520fd2'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:41 devstack sudo[83757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:03:41 devstack sudo[83757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:41 devstack sudo[83754]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.473s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:03:41 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] Deleted volume successfully. Apr 21 02:03:41 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5ff7ece5-38af-455a-8b1d-5ba46ebb07a9 tempest-DeleteServersTestJSON-1397650295 None] Lock "cinder-f2517de6-ab4e-4ac7-b7cf-309b1c2588f1-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:42 devstack sudo[83757]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.465s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:03:42 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] Deleted volume successfully. Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d8cc1153-e645-4497-be53-8616471ff1ec tempest-VolumeQuotasNegativeTestJSON-180399006 None] Lock "cinder-4380fed4-61fa-4a91-8c01-713ec4609dbb-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Flow 'volume_create_manager' (dba2a53b-2b09-4cc6-b03b-f966a99f41c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41ad351-1fc4-4211-b6b8-03b418a94322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41ad351-1fc4-4211-b6b8-03b418a94322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-381919932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1c49b2ef-a708-4e9a-8d9b-e75c52163460,host='devstack@QuobyteHD#QuobyteHD',id=b6ecd8c4-3911-482e-8f2c-4b12585e4c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8180f8cab9147eeacef8ad23cd672c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:03:43Z,use_quota=True,user_id='e31da291e81c4392a2e8e552bfab70f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fdce083e-3ceb-4318-84b0-4cac5d427bb1),volume_type_id=fdce083e-3ceb-4318-84b0-4cac5d427bb1)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ddef5e-e690-4071-ad84-110397e12d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ddef5e-e690-4071-ad84-110397e12d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1998f8a3-14ed-4eb9-b477-1512b2841810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1998f8a3-14ed-4eb9-b477-1512b2841810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6ecd8c4-3911-482e-8f2c-4b12585e4c96', 'volume_name': 'volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f959f833-b54b-4fde-a7da-46e2bfecb769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f959f833-b54b-4fde-a7da-46e2bfecb769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878eaf28-2aa8-4584-866c-0efcfdcbd8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:42 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Volume b6ecd8c4-3911-482e-8f2c-4b12585e4c96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96', 'volume_size': 1} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1c49b2ef-a708-4e9a-8d9b-e75c52163460,created_at=2026-04-21T00:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-381919932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1c49b2ef-a708-4e9a-8d9b-e75c52163460,host='devstack@QuobyteHD#QuobyteHD',id=b6ecd8c4-3911-482e-8f2c-4b12585e4c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8180f8cab9147eeacef8ad23cd672c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:03:43Z,use_quota=True,user_id='e31da291e81c4392a2e8e552bfab70f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fdce083e-3ceb-4318-84b0-4cac5d427bb1),volume_type_id=fdce083e-3ceb-4318-84b0-4cac5d427bb1)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Creating volume b6ecd8c4-3911-482e-8f2c-4b12585e4c96 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:03:42 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:03:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:42 devstack sudo[83761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96 1073741824 Apr 21 02:03:42 devstack sudo[83761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:43 devstack sudo[83761]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96 1073741824" returned: 0 in 0.605s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:43 devstack sudo[83766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96 Apr 21 02:03:43 devstack sudo[83766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:43 devstack sudo[83766]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96" returned: 0 in 0.464s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:03:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878eaf28-2aa8-4584-866c-0efcfdcbd8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8b4c67-1a62-4cb9-887d-f8d36d91faa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:43 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Volume volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96 (b6ecd8c4-3911-482e-8f2c-4b12585e4c96): created successfully Apr 21 02:03:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8b4c67-1a62-4cb9-887d-f8d36d91faa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Flow 'volume_create_manager' (dba2a53b-2b09-4cc6-b03b-f966a99f41c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:03:43 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-e13c2a43-82fa-4867-8102-3ede27d0e14d tempest-GroupSnapshotsTest-2104303601 None] Created volume successfully. Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Flow 'volume_create_manager' (a1a1d3f7-de73-4815-8af1-ee0a5eb65a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a82cda-7eb7-4541-99a6-2cd06f49aee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a82cda-7eb7-4541-99a6-2cd06f49aee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-683195150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1c49b2ef-a708-4e9a-8d9b-e75c52163460,host='devstack@QuobyteHD#QuobyteHD',id=9c5e02a3-ad90-401a-a431-0063fff6151a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8180f8cab9147eeacef8ad23cd672c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:03:45Z,use_quota=True,user_id='e31da291e81c4392a2e8e552bfab70f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fdce083e-3ceb-4318-84b0-4cac5d427bb1),volume_type_id=fdce083e-3ceb-4318-84b0-4cac5d427bb1)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902f7e87-27c8-49fd-9e10-6fd927b673c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902f7e87-27c8-49fd-9e10-6fd927b673c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1632f7d-a0dc-4153-8f3e-3fbcad9d98a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1632f7d-a0dc-4153-8f3e-3fbcad9d98a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c5e02a3-ad90-401a-a431-0063fff6151a', 'volume_name': 'volume-9c5e02a3-ad90-401a-a431-0063fff6151a', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf47099-9e9f-44dc-bd02-b7d6241ebe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf47099-9e9f-44dc-bd02-b7d6241ebe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318a5181-63d2-48a0-8291-901e1dc07f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:45 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Volume 9c5e02a3-ad90-401a-a431-0063fff6151a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c5e02a3-ad90-401a-a431-0063fff6151a', 'volume_size': 1} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1c49b2ef-a708-4e9a-8d9b-e75c52163460,created_at=2026-04-21T00:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-683195150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1c49b2ef-a708-4e9a-8d9b-e75c52163460,host='devstack@QuobyteHD#QuobyteHD',id=9c5e02a3-ad90-401a-a431-0063fff6151a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8180f8cab9147eeacef8ad23cd672c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:03:45Z,use_quota=True,user_id='e31da291e81c4392a2e8e552bfab70f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fdce083e-3ceb-4318-84b0-4cac5d427bb1),volume_type_id=fdce083e-3ceb-4318-84b0-4cac5d427bb1)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Creating volume 9c5e02a3-ad90-401a-a431-0063fff6151a {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:03:45 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:45 devstack sudo[83771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a 1073741824 Apr 21 02:03:45 devstack sudo[83771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:45 devstack sudo[83771]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a 1073741824" returned: 0 in 0.570s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:45 devstack sudo[83777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a Apr 21 02:03:45 devstack sudo[83777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:46 devstack sudo[83777]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a" returned: 0 in 0.550s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:03:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318a5181-63d2-48a0-8291-901e1dc07f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c5e02a3-ad90-401a-a431-0063fff6151a', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5609ae-e02c-421a-970e-acc14d127929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:46 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Volume volume-9c5e02a3-ad90-401a-a431-0063fff6151a (9c5e02a3-ad90-401a-a431-0063fff6151a): created successfully Apr 21 02:03:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5609ae-e02c-421a-970e-acc14d127929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Flow 'volume_create_manager' (a1a1d3f7-de73-4815-8af1-ee0a5eb65a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:03:46 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-5e60dc5d-3c60-4775-9aaa-acb73a0443a5 tempest-GroupSnapshotsTest-2104303601 None] Created volume successfully. Apr 21 02:03:47 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-d420ce19-908f-44de-a153-9067b7fc354c tempest-GroupSnapshotsTest-2104303601 None] Update group completed successfully. Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Flow 'volume_create_manager' (ec802f82-c51f-41b5-8998-99e3bf91b069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b9fb86-5594-415c-807e-aa92abd6f6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b9fb86-5594-415c-807e-aa92abd6f6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1549996061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1733208e-1d31-4afa-9a9e-5b0ee7e974c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='318d7b34bded46a5994fb6a0a1ba5654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:03:48Z,use_quota=True,user_id='15e7e2dda0d24386975935690dbda875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94aec96e-2943-4ebf-b47c-c6ebe3a7292b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94aec96e-2943-4ebf-b47c-c6ebe3a7292b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca96f363-a81e-411b-8eab-0cbdd3f6c87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca96f363-a81e-411b-8eab-0cbdd3f6c87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1733208e-1d31-4afa-9a9e-5b0ee7e974c3', 'volume_name': 'volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea0a751-9ef5-4cb2-84fb-744e7d572d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea0a751-9ef5-4cb2-84fb-744e7d572d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4131d833-94ed-46f1-9513-2745e671a9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:48 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Volume 1733208e-1d31-4afa-9a9e-5b0ee7e974c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3', 'volume_size': 1} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1549996061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1733208e-1d31-4afa-9a9e-5b0ee7e974c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='318d7b34bded46a5994fb6a0a1ba5654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:03:48Z,use_quota=True,user_id='15e7e2dda0d24386975935690dbda875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Creating volume 1733208e-1d31-4afa-9a9e-5b0ee7e974c3 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:03:48 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:48 devstack sudo[83780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3 1073741824 Apr 21 02:03:48 devstack sudo[83780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:48 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-3be90572-6239-4e64-9d9e-4002ff65638b tempest-GroupSnapshotsTest-2104303601 None] Update group completed successfully. Apr 21 02:03:48 devstack sudo[83780]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3 1073741824" returned: 0 in 0.646s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:49 devstack sudo[83792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3 Apr 21 02:03:49 devstack sudo[83792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:49 devstack sudo[83792]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3" returned: 0 in 0.622s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:49 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:03:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4131d833-94ed-46f1-9513-2745e671a9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4dcd2d-92cc-44e5-94c2-1f849e8e9fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:03:49 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Volume volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3 (1733208e-1d31-4afa-9a9e-5b0ee7e974c3): created successfully Apr 21 02:03:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4dcd2d-92cc-44e5-94c2-1f849e8e9fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:03:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Flow 'volume_create_manager' (ec802f82-c51f-41b5-8998-99e3bf91b069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:03:49 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-dfe2eca3-4e0a-4c3a-9689-1c09b3c2bbf6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Created volume successfully. Apr 21 02:03:49 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-f66d303a-c300-4a33-8ced-9bfa1e165b51 tempest-GroupSnapshotsTest-2104303601 None] Update group completed successfully. Apr 21 02:03:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:50 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Creating offline snapshot 4db42804-5d7b-465d-9096-e8068b936fd5 of volume 1733208e-1d31-4afa-9a9e-5b0ee7e974c3 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:03:50 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[01109936-e975-4ff9-9d8d-e8b7b0e774da]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:50 devstack sudo[83829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3 Apr 21 02:03:50 devstack sudo[83829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:51 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-045b07fe-9798-4032-9420-a0578a8287a8 tempest-GroupSnapshotsTest-2104303601 None] Update group completed successfully. Apr 21 02:03:51 devstack sudo[83829]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3" returned: 0 in 0.614s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:51 devstack sudo[83838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5 1G Apr 21 02:03:51 devstack sudo[83838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:51 devstack sudo[83838]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5 1G" returned: 0 in 0.640s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:51 devstack sudo[83850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5 Apr 21 02:03:51 devstack sudo[83850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:52 devstack sudo[83850]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5" returned: 0 in 0.529s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:52 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5 is being set with open permissions: ugo+rw Apr 21 02:03:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:52 devstack sudo[83856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5 Apr 21 02:03:52 devstack sudo[83856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:52 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] GroupSnapshot 1e916696-10f5-40b6-bde9-e2e4f010d811: creating. Apr 21 02:03:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Group snapshot 1e916696-10f5-40b6-bde9-e2e4f010d811: creating. {{(pid=82184) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 02:03:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:52 devstack sudo[83856]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5" returned: 0 in 0.445s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:52 devstack sudo[83861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.info Apr 21 02:03:52 devstack sudo[83861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:53 devstack sudo[83861]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.info" returned: 0 in 0.457s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:53 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.info is being set with open permissions: ugo+rw Apr 21 02:03:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:53 devstack sudo[83864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.info Apr 21 02:03:53 devstack sudo[83864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:53 devstack sudo[83864]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.info" returned: 0 in 0.500s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.239s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.245s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:53 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Creating offline snapshot 5d9e03e7-4d9c-41d5-bfae-2e25916e25bf of volume 9c5e02a3-ad90-401a-a431-0063fff6151a {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:03:53 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d046a2c-3f5a-4c1b-95fa-4afa5b1eb79c]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:53 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-a7e9b1ec-9877-42ad-8848-fe496ef73c6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Create snapshot completed successfully Apr 21 02:03:53 devstack sudo[83867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a Apr 21 02:03:53 devstack sudo[83867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:54 devstack sudo[83867]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a" returned: 0 in 0.574s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:54 devstack sudo[83872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf 1G Apr 21 02:03:54 devstack sudo[83872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:54 devstack sudo[83872]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf 1G" returned: 0 in 0.656s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c5e02a3-ad90-401a-a431-0063fff6151a -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:54 devstack sudo[83878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c5e02a3-ad90-401a-a431-0063fff6151a -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf Apr 21 02:03:54 devstack sudo[83878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Acquiring lock "cinder-4db42804-5d7b-465d-9096-e8068b936fd5-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Lock "cinder-4db42804-5d7b-465d-9096-e8068b936fd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Acquiring lock "cinder-quobyte-1733208e-1d31-4afa-9a9e-5b0ee7e974c3" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Lock "cinder-quobyte-1733208e-1d31-4afa-9a9e-5b0ee7e974c3" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Acquiring lock "cinder-quobyte-4db42804-5d7b-465d-9096-e8068b936fd5" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Lock "cinder-quobyte-4db42804-5d7b-465d-9096-e8068b936fd5" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Deleting offline snapshot 4db42804-5d7b-465d-9096-e8068b936fd5 of volume 1733208e-1d31-4afa-9a9e-5b0ee7e974c3 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:03:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] snapshot_file for this snap is: volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:03:55 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[085abed8-53ce-4976-9b01-93ed99aee508]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:55 devstack sudo[83880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5 Apr 21 02:03:55 devstack sudo[83880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:55 devstack sudo[83878]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c5e02a3-ad90-401a-a431-0063fff6151a -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf" returned: 0 in 0.547s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:55 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf is being set with open permissions: ugo+rw: NotImplementedError Apr 21 02:03:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:55 devstack sudo[83886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf Apr 21 02:03:55 devstack sudo[83886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:55 devstack sudo[83880]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5" returned: 0 in 0.648s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:03:55 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0333fe76-86fa-42da-b79f-edcc01df229a]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:55 devstack sudo[83891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3 Apr 21 02:03:55 devstack sudo[83891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:56 devstack sudo[83886]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf" returned: 0 in 0.652s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:56 devstack sudo[83894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.info Apr 21 02:03:56 devstack sudo[83894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:56 devstack sudo[83891]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3" returned: 0 in 0.597s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:56 devstack sudo[83899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5 Apr 21 02:03:56 devstack sudo[83899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:56 devstack sudo[83894]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.info" returned: 0 in 0.653s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:56 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 02:03:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:56 devstack sudo[83908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.info Apr 21 02:03:56 devstack sudo[83908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:57 devstack sudo[83899]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5" returned: 0 in 0.595s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:57 devstack sudo[83910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5 Apr 21 02:03:57 devstack sudo[83910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:57 devstack sudo[83910]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3.4db42804-5d7b-465d-9096-e8068b936fd5" returned: 0 in 0.490s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:57 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Lock "cinder-quobyte-4db42804-5d7b-465d-9096-e8068b936fd5" released by "_delete_snapshot" :: held 2.409s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:57 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Lock "cinder-quobyte-1733208e-1d31-4afa-9a9e-5b0ee7e974c3" released by "delete_snapshot" :: held 2.420s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:57 devstack cinder-volume[82184]: WARNING cinder.quota [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:03:57 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Created reservations ['6f4b4381-ecde-4603-b295-17f40935c88a', '1c959e21-bac6-4016-b632-4bf96e2d442e', 'fc7a088b-ea62-413d-8934-aefdb2d22dfd', 'f2e1384b-2e48-4780-b757-1dc1f2489680'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:03:57 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Delete snapshot completed successfully. Apr 21 02:03:57 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b522ff6d-d33a-4273-ae88-2a0d1b5d68c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Lock "cinder-4db42804-5d7b-465d-9096-e8068b936fd5-delete_snapshot" released by "delete_snapshot" :: held 2.523s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:57 devstack sudo[83908]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.info" returned: 0 in 0.763s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.932s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:57 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Creating offline snapshot ed4df5c0-d9f5-426d-878b-1eb87be1ddce of volume b6ecd8c4-3911-482e-8f2c-4b12585e4c96 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:03:57 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1336e4aa-bbb7-4580-a6e3-0e37674f1a33]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:57 devstack sudo[83926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96 Apr 21 02:03:57 devstack sudo[83926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:58 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Acquiring lock "cinder-1733208e-1d31-4afa-9a9e-5b0ee7e974c3-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:58 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Lock "cinder-1733208e-1d31-4afa-9a9e-5b0ee7e974c3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:58 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Acquiring lock "cinder-quobyte-1733208e-1d31-4afa-9a9e-5b0ee7e974c3" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:03:58 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Lock "cinder-quobyte-1733208e-1d31-4afa-9a9e-5b0ee7e974c3" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:03:58 devstack sudo[83926]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96" returned: 0 in 0.692s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:58 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d923919a-e898-400f-a68d-2c82c2426dc7]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:03:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:58 devstack sudo[83941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce 1G Apr 21 02:03:58 devstack sudo[83941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:58 devstack sudo[83942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3 Apr 21 02:03:58 devstack sudo[83942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:58 devstack sudo[83941]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce 1G" returned: 0 in 0.544s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:58 devstack sudo[83954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce Apr 21 02:03:58 devstack sudo[83954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:58 devstack sudo[83942]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3" returned: 0 in 0.571s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:59 devstack sudo[83958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3 Apr 21 02:03:59 devstack sudo[83958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:59 devstack sudo[83958]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1733208e-1d31-4afa-9a9e-5b0ee7e974c3" returned: 0 in 0.470s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:59 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Lock "cinder-quobyte-1733208e-1d31-4afa-9a9e-5b0ee7e974c3" released by "delete_volume" :: held 1.108s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:03:59 devstack sudo[83954]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce" returned: 0 in 0.545s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:59 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce is being set with open permissions: ugo+rw: NotImplementedError Apr 21 02:03:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:59 devstack sudo[83976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce Apr 21 02:03:59 devstack sudo[83976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:59 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Created reservations ['6e780f9b-57c0-4e01-b4f4-3f8582554074', '5b7c44c2-bda5-4463-be84-6a95952a7414', 'de511bfb-2194-4831-9858-bf2af74e978e', '55103f40-952c-427e-96ee-829c0a80cf8c'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:03:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:03:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:03:59 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:03:59 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:03:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:03:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:03:59 devstack sudo[83978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:03:59 devstack sudo[83978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:03:59 devstack sudo[83976]: pam_unix(sudo:session): session closed for user root Apr 21 02:03:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce" returned: 0 in 0.508s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:03:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:00 devstack sudo[83982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.info Apr 21 02:04:00 devstack sudo[83978]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:00 devstack sudo[83982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.463s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:00 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:04:00 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Deleted volume successfully. Apr 21 02:04:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-165425b9-3227-42fb-a917-00ea1fd44810 tempest-VolumeSnapshotQuotasNegativeTestJSON-1292192182 None] Lock "cinder-1733208e-1d31-4afa-9a9e-5b0ee7e974c3-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:04:00 devstack sudo[83982]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.info" returned: 0 in 0.428s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:00 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 02:04:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:00 devstack sudo[83987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.info Apr 21 02:04:00 devstack sudo[83987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:00 devstack sudo[83987]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.info" returned: 0 in 0.559s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.352s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:01 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-07cb5c7f-ebdb-4db0-958d-286d53db86bc tempest-GroupSnapshotsTest-2104303601 None] group_snapshot 1e916696-10f5-40b6-bde9-e2e4f010d811: created successfully Apr 21 02:04:01 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] group_snapshot 1e916696-10f5-40b6-bde9-e2e4f010d811: deleting Apr 21 02:04:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] group_snapshot 1e916696-10f5-40b6-bde9-e2e4f010d811: deleting {{(pid=82184) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 02:04:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "cinder-quobyte-9c5e02a3-ad90-401a-a431-0063fff6151a" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-9c5e02a3-ad90-401a-a431-0063fff6151a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "cinder-quobyte-5d9e03e7-4d9c-41d5-bfae-2e25916e25bf" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-5d9e03e7-4d9c-41d5-bfae-2e25916e25bf" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Deleting offline snapshot 5d9e03e7-4d9c-41d5-bfae-2e25916e25bf of volume 9c5e02a3-ad90-401a-a431-0063fff6151a {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:04:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] snapshot_file for this snap is: volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:04:02 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79728f6-435c-4b20-b7f3-2045e4572aeb]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:02 devstack sudo[84033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf Apr 21 02:04:02 devstack sudo[84033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:03 devstack sudo[84033]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf" returned: 0 in 0.977s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c5e02a3-ad90-401a-a431-0063fff6151a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:04:03 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1b2393-c935-4296-baf4-e3067eb905b5]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:03 devstack sudo[84047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a Apr 21 02:04:03 devstack sudo[84047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:04 devstack sudo[84047]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a" returned: 0 in 1.255s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:04 devstack sudo[84083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf Apr 21 02:04:04 devstack sudo[84083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:05 devstack sudo[84083]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf" returned: 0 in 0.691s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:05 devstack sudo[84102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf Apr 21 02:04:05 devstack sudo[84102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Flow 'volume_create_manager' (f860d490-dd21-406a-ace1-ebdfa3c8f44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df97e8f9-be6c-42e8-9805-bb383050d9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df97e8f9-be6c-42e8-9805-bb383050d9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-112153493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef05b24-bb42-4e01-b34f-c093181369f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d718b436ea1c4767b35de6e2542f4cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:04:06Z,use_quota=True,user_id='feb3d119759f49c3b0dc6e7a37e790ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9091341-262f-41fa-a539-b64bb6716a6d),volume_type_id=f9091341-262f-41fa-a539-b64bb6716a6d)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (545f5f3d-9441-401c-964a-94bc4a785d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (545f5f3d-9441-401c-964a-94bc4a785d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca44f1d1-d21b-4d41-893d-bcef70a65363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca44f1d1-d21b-4d41-893d-bcef70a65363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ef05b24-bb42-4e01-b34f-c093181369f3', 'volume_name': 'volume-6ef05b24-bb42-4e01-b34f-c093181369f3', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (079717a4-704f-40de-9403-adb54658cb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (079717a4-704f-40de-9403-adb54658cb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0d04d9-f96f-4132-99ca-816bb8786ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:06 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Volume 6ef05b24-bb42-4e01-b34f-c093181369f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ef05b24-bb42-4e01-b34f-c093181369f3', 'volume_size': 1} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-112153493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef05b24-bb42-4e01-b34f-c093181369f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d718b436ea1c4767b35de6e2542f4cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:04:06Z,use_quota=True,user_id='feb3d119759f49c3b0dc6e7a37e790ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9091341-262f-41fa-a539-b64bb6716a6d),volume_type_id=f9091341-262f-41fa-a539-b64bb6716a6d)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Creating volume 6ef05b24-bb42-4e01-b34f-c093181369f3 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:04:06 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ef05b24-bb42-4e01-b34f-c093181369f3 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:06 devstack sudo[84102]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a.5d9e03e7-4d9c-41d5-bfae-2e25916e25bf" returned: 0 in 1.033s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:06 devstack sudo[84105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ef05b24-bb42-4e01-b34f-c093181369f3 1073741824 Apr 21 02:04:06 devstack sudo[84105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-5d9e03e7-4d9c-41d5-bfae-2e25916e25bf" released by "_delete_snapshot" :: held 4.160s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-9c5e02a3-ad90-401a-a431-0063fff6151a" released by "delete_snapshot" :: held 4.177s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "cinder-quobyte-b6ecd8c4-3911-482e-8f2c-4b12585e4c96" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-b6ecd8c4-3911-482e-8f2c-4b12585e4c96" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "cinder-quobyte-ed4df5c0-d9f5-426d-878b-1eb87be1ddce" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-ed4df5c0-d9f5-426d-878b-1eb87be1ddce" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Deleting offline snapshot ed4df5c0-d9f5-426d-878b-1eb87be1ddce of volume b6ecd8c4-3911-482e-8f2c-4b12585e4c96 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] snapshot_file for this snap is: volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e0572d-8594-4fc1-a187-cc133b03fc77]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:06 devstack sudo[84107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce Apr 21 02:04:06 devstack sudo[84107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:06 devstack sudo[84107]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce" returned: 0 in 0.642s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb2a2fd-a422-4d8f-89c1-a9af7418315e]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:07 devstack sudo[84105]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ef05b24-bb42-4e01-b34f-c093181369f3 1073741824" returned: 0 in 0.928s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ef05b24-bb42-4e01-b34f-c093181369f3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:07 devstack sudo[84115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96 Apr 21 02:04:07 devstack sudo[84115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:07 devstack sudo[84116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ef05b24-bb42-4e01-b34f-c093181369f3 Apr 21 02:04:07 devstack sudo[84116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:07 devstack sudo[84115]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96" returned: 0 in 0.769s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:07 devstack sudo[84124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce Apr 21 02:04:07 devstack sudo[84124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:07 devstack sudo[84116]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ef05b24-bb42-4e01-b34f-c093181369f3" returned: 0 in 0.788s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:07 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:04:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:07 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:SELECT=123,cinder:UPDATE=122,cinder:DELETE=7,cinder:INSERT=31 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:04:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0d04d9-f96f-4132-99ca-816bb8786ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef05b24-bb42-4e01-b34f-c093181369f3', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b1e194-249e-4cd9-ad71-5b39845c3ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:07 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:SELECT=124,cinder:UPDATE=130,cinder:INSERT=25,cinder:DELETE=9 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:04:07 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Volume volume-6ef05b24-bb42-4e01-b34f-c093181369f3 (6ef05b24-bb42-4e01-b34f-c093181369f3): created successfully Apr 21 02:04:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b1e194-249e-4cd9-ad71-5b39845c3ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Flow 'volume_create_manager' (f860d490-dd21-406a-ace1-ebdfa3c8f44b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:04:07 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-878bb90c-ff2f-4328-aff5-fc2c4df54183 tempest-VolumeTypesAccessTest-1673953590 None] Created volume successfully. Apr 21 02:04:08 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Acquiring lock "cinder-6ef05b24-bb42-4e01-b34f-c093181369f3-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:08 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Lock "cinder-6ef05b24-bb42-4e01-b34f-c093181369f3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:08 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Acquiring lock "cinder-quobyte-6ef05b24-bb42-4e01-b34f-c093181369f3" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:08 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Lock "cinder-quobyte-6ef05b24-bb42-4e01-b34f-c093181369f3" acquired by "delete_volume" :: waited 0.021s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:08 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a600d4-cf0a-4d88-bc78-0e40f4f12c6e]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ef05b24-bb42-4e01-b34f-c093181369f3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:08 devstack sudo[84124]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce" returned: 0 in 0.672s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:08 devstack sudo[84133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ef05b24-bb42-4e01-b34f-c093181369f3 Apr 21 02:04:08 devstack sudo[84133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:08 devstack sudo[84134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce Apr 21 02:04:08 devstack sudo[84134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:08 devstack sudo[84133]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ef05b24-bb42-4e01-b34f-c093181369f3" returned: 0 in 0.660s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ef05b24-bb42-4e01-b34f-c093181369f3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:09 devstack sudo[84140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ef05b24-bb42-4e01-b34f-c093181369f3 Apr 21 02:04:09 devstack sudo[84140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:09 devstack sudo[84134]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96.ed4df5c0-d9f5-426d-878b-1eb87be1ddce" returned: 0 in 0.896s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:09 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-ed4df5c0-d9f5-426d-878b-1eb87be1ddce" released by "_delete_snapshot" :: held 3.099s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:04:09 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-b6ecd8c4-3911-482e-8f2c-4b12585e4c96" released by "delete_snapshot" :: held 3.115s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:04:09 devstack cinder-volume[82184]: WARNING cinder.quota [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1999850059 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1999850059, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:04:09 devstack cinder-volume[82184]: WARNING cinder.quota [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1999850059 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1999850059, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:04:09 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Created reservations ['da430740-31d6-4797-b1bf-9159bae8bbe7', '86c43d50-d039-41c2-bfe5-ea7f02e6329e', '64c17cac-0518-4d28-b245-d40193a94f3a', 'ec443ec7-774e-4a7a-af2e-5496d740cdab'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:04:09 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] Created reservations ['733dbabf-658b-430d-8daf-3589274d440b', 'dc6e543f-dcc5-45d7-911e-45ca74dc0c04', 'ecff5c59-5345-4674-acf3-86105a3d9442', '01ce52af-cb60-4e99-aa8c-d00b7a1e72e1'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:04:09 devstack sudo[84140]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ef05b24-bb42-4e01-b34f-c093181369f3" returned: 0 in 0.555s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:09 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-6458d2b8-3e44-4d5e-9bfa-f32eac7367bc tempest-GroupSnapshotsTest-2104303601 None] group_snapshot 1e916696-10f5-40b6-bde9-e2e4f010d811: deleted successfully Apr 21 02:04:09 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Lock "cinder-quobyte-6ef05b24-bb42-4e01-b34f-c093181369f3" released by "delete_volume" :: held 1.271s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:04:09 devstack cinder-volume[82184]: WARNING cinder.quota [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-212968289 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-212968289, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:04:09 devstack cinder-volume[82184]: WARNING cinder.quota [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-212968289 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-212968289, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:04:09 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Created reservations ['702b6663-21e7-4dd4-b864-235969aca352', '3d3144f1-72b7-4d06-bb3f-b4d64a137665', '5815c251-62a8-4218-99c6-8d085b4e2832', '7723d81c-3c95-43db-9620-8a2a967c2686'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:04:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:04:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:04:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:09 devstack sudo[84144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:04:09 devstack sudo[84144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:10 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "cinder-quobyte-9c5e02a3-ad90-401a-a431-0063fff6151a" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:10 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-9c5e02a3-ad90-401a-a431-0063fff6151a" acquired by "delete_volume" :: waited 0.027s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:10 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a52de5-e817-4fb0-aa23-12d50b46e6b6]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:10 devstack sudo[84171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a Apr 21 02:04:10 devstack sudo[84171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:10 devstack sudo[84144]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 1.155s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:10 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:04:10 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Deleted volume successfully. Apr 21 02:04:10 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-48fea9b0-4bbb-4214-900e-e4c147eac566 tempest-VolumeTypesAccessTest-1673953590 None] Lock "cinder-6ef05b24-bb42-4e01-b34f-c093181369f3-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:04:11 devstack sudo[84171]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a" returned: 0 in 1.451s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:11 devstack sudo[84202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a Apr 21 02:04:11 devstack sudo[84202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:12 devstack sudo[84202]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9c5e02a3-ad90-401a-a431-0063fff6151a" returned: 0 in 1.111s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:12 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-9c5e02a3-ad90-401a-a431-0063fff6151a" released by "delete_volume" :: held 2.681s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:04:12 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "cinder-quobyte-b6ecd8c4-3911-482e-8f2c-4b12585e4c96" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:12 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-b6ecd8c4-3911-482e-8f2c-4b12585e4c96" acquired by "delete_volume" :: waited 0.022s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:12 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[323345d2-c575-404b-b107-ef412130ef88]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:13 devstack sudo[84214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96 Apr 21 02:04:13 devstack sudo[84214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:13 devstack sudo[84214]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96" returned: 0 in 0.930s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:13 devstack sudo[84221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96 Apr 21 02:04:13 devstack sudo[84221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:14 devstack sudo[84221]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b6ecd8c4-3911-482e-8f2c-4b12585e4c96" returned: 0 in 0.629s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-b6ecd8c4-3911-482e-8f2c-4b12585e4c96" released by "delete_volume" :: held 1.620s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:04:14 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Created reservations ['c7fc9af1-f5c4-4c3d-8f41-056afcf1ec6a'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:04:14 devstack cinder-volume[82184]: WARNING cinder.quota [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1999850059 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1999850059, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:04:14 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Created reservations ['9946cdf6-5cac-4c0f-af1b-5ab9e4315bb7', '5f4c8249-6e88-4a2f-b3f4-440a4ba61ec6', '270cc295-52d7-4821-b220-622c296e0ff4', 'f5e8c61d-fd4b-4efe-ba68-003ca34903cc'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:04:14 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Created reservations ['46b78284-6a72-4696-bbc6-8651e2f93d1e', '8d769edd-32d3-42e1-9010-606206560a86', '2253bc81-d96d-4f25-8358-867b4137277c', 'bae0f129-d213-4f7a-ba9e-8359dedf54d5'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:04:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:04:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:04:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:15 devstack sudo[84228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:04:15 devstack sudo[84228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:15 devstack sudo[84228]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.523s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:15 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:04:15 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-f0bc3ddc-0183-4947-9aa4-86cb339654ab tempest-GroupSnapshotsTest-2104303601 None] Delete group completed successfully. Apr 21 02:04:16 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b18a60bf-2e69-4dfb-846d-000ca6ce95f6 tempest-GroupSnapshotsTest-2104303601 None] Group tempest-GroupSnapshotsTest-Group-2013691414: creating Apr 21 02:04:16 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b18a60bf-2e69-4dfb-846d-000ca6ce95f6 tempest-GroupSnapshotsTest-2104303601 None] Group tempest-GroupSnapshotsTest-Group-2013691414: created successfully Apr 21 02:04:16 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b18a60bf-2e69-4dfb-846d-000ca6ce95f6 tempest-GroupSnapshotsTest-2104303601 None] Create group completed successfully. Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Flow 'volume_create_manager' (42439d3d-c29e-424c-9b5d-1e5d3b06d743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7372d9-b8b3-402a-b885-6babc2323ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7372d9-b8b3-402a-b885-6babc2323ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-767008932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e395aa6d-e84e-4462-bd11-86ea622d9a73,host='devstack@QuobyteHD#QuobyteHD',id=cd7ec11e-6e06-48c0-aea9-35fbebaff464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8180f8cab9147eeacef8ad23cd672c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:04:18Z,use_quota=True,user_id='e31da291e81c4392a2e8e552bfab70f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57803658-a7c0-4bc9-afd7-fb8cde7da510),volume_type_id=57803658-a7c0-4bc9-afd7-fb8cde7da510)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaccd84b-a3c3-4a35-b75b-98b336eb1435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaccd84b-a3c3-4a35-b75b-98b336eb1435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e8633b-5273-448d-a4db-0dd5f5cfcf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e8633b-5273-448d-a4db-0dd5f5cfcf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd7ec11e-6e06-48c0-aea9-35fbebaff464', 'volume_name': 'volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7df20d-ce01-499e-8fc2-aad08441a3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7df20d-ce01-499e-8fc2-aad08441a3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7281982a-55e3-4de5-9395-7ffbd0932adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:18 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Volume cd7ec11e-6e06-48c0-aea9-35fbebaff464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464', 'volume_size': 1} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e395aa6d-e84e-4462-bd11-86ea622d9a73,created_at=2026-04-21T00:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-767008932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e395aa6d-e84e-4462-bd11-86ea622d9a73,host='devstack@QuobyteHD#QuobyteHD',id=cd7ec11e-6e06-48c0-aea9-35fbebaff464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8180f8cab9147eeacef8ad23cd672c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:04:18Z,use_quota=True,user_id='e31da291e81c4392a2e8e552bfab70f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57803658-a7c0-4bc9-afd7-fb8cde7da510),volume_type_id=57803658-a7c0-4bc9-afd7-fb8cde7da510)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Creating volume cd7ec11e-6e06-48c0-aea9-35fbebaff464 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:04:18 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:04:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:18 devstack sudo[84289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464 1073741824 Apr 21 02:04:18 devstack sudo[84289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:19 devstack sudo[84289]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464 1073741824" returned: 0 in 1.265s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:19 devstack sudo[84295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464 Apr 21 02:04:19 devstack sudo[84295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:20 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:04:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Flow 'volume_create_manager' (3c4d9a5b-f32f-467d-82e4-f5dee6619353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:04:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee866182-8c16-4ce3-b91b-3367feb753ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee866182-8c16-4ce3-b91b-3367feb753ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-728617249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b5b9a51-5072-45ee-9e34-847ccbe944b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c71dba09be904d618c0d13ee88781bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:04:20Z,use_quota=True,user_id='d65030119e2b4851819491d337412a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e4f833-dd41-4c8b-bc01-14a6fe1f0f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e4f833-dd41-4c8b-bc01-14a6fe1f0f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40c174fd-fb93-4b65-9ea1-c2e357fa9bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40c174fd-fb93-4b65-9ea1-c2e357fa9bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b5b9a51-5072-45ee-9e34-847ccbe944b8', 'volume_name': 'volume-5b5b9a51-5072-45ee-9e34-847ccbe944b8', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53751941-a6f7-49a7-86ed-03f0764bed44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53751941-a6f7-49a7-86ed-03f0764bed44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002e257d-a36b-4d93-88e6-b1d6a7dc4dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:20 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Volume 5b5b9a51-5072-45ee-9e34-847ccbe944b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b5b9a51-5072-45ee-9e34-847ccbe944b8', 'volume_size': 1} Apr 21 02:04:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:21 devstack sudo[84295]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464" returned: 0 in 1.232s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] <== create_volume: return (2554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:04:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.558s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.520s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-728617249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b5b9a51-5072-45ee-9e34-847ccbe944b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c71dba09be904d618c0d13ee88781bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:04:20Z,use_quota=True,user_id='d65030119e2b4851819491d337412a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:04:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Creating volume 5b5b9a51-5072-45ee-9e34-847ccbe944b8 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:04:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:04:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:04:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:04:21 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:04:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5b5b9a51-5072-45ee-9e34-847ccbe944b8 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:21 devstack sudo[84311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5b5b9a51-5072-45ee-9e34-847ccbe944b8 1073741824 Apr 21 02:04:21 devstack sudo[84311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7281982a-55e3-4de5-9395-7ffbd0932adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21850bdb-039b-47fc-858d-5ebb8f1db0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:21 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Volume volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464 (cd7ec11e-6e06-48c0-aea9-35fbebaff464): created successfully Apr 21 02:04:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21850bdb-039b-47fc-858d-5ebb8f1db0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Flow 'volume_create_manager' (42439d3d-c29e-424c-9b5d-1e5d3b06d743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:04:21 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-e51cfcc8-e98e-498f-ad9e-6ebcbfdce8fd tempest-GroupSnapshotsTest-2104303601 None] Created volume successfully. Apr 21 02:04:22 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] GroupSnapshot 2f27fc36-7585-4afb-875e-d031de00741c: creating. Apr 21 02:04:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] Group snapshot 2f27fc36-7585-4afb-875e-d031de00741c: creating. {{(pid=82184) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 02:04:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:22 devstack sudo[84311]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5b5b9a51-5072-45ee-9e34-847ccbe944b8 1073741824" returned: 0 in 1.460s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5b5b9a51-5072-45ee-9e34-847ccbe944b8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:22 devstack sudo[84328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5b5b9a51-5072-45ee-9e34-847ccbe944b8 Apr 21 02:04:22 devstack sudo[84328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:23 devstack sudo[84328]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5b5b9a51-5072-45ee-9e34-847ccbe944b8" returned: 0 in 0.924s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] <== create_volume: return (2445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:04:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.448s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.985s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:23 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002e257d-a36b-4d93-88e6-b1d6a7dc4dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b5b9a51-5072-45ee-9e34-847ccbe944b8', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:23 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5c3121-99b1-4b89-9332-da902c7b00f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:23 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Volume volume-5b5b9a51-5072-45ee-9e34-847ccbe944b8 (5b5b9a51-5072-45ee-9e34-847ccbe944b8): created successfully Apr 21 02:04:23 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5c3121-99b1-4b89-9332-da902c7b00f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:23 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Flow 'volume_create_manager' (3c4d9a5b-f32f-467d-82e4-f5dee6619353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:04:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] Creating offline snapshot 350e5d3e-d900-4bfe-bdfe-115cf66603c1 of volume cd7ec11e-6e06-48c0-aea9-35fbebaff464 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:04:23 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-962dc38c-38b5-42ff-af87-274bc1381094 tempest-ServerRescueNegativeTestJSON-822049827 None] Created volume successfully. Apr 21 02:04:23 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[289b786f-0289-47ca-8e06-35a519e61b42]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:23 devstack sudo[84331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464 Apr 21 02:04:23 devstack sudo[84331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:24 devstack sudo[84331]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464" returned: 0 in 0.908s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:24 devstack sudo[84337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1 1G Apr 21 02:04:24 devstack sudo[84337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:25 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:04:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Flow 'volume_create_manager' (5aedab21-af2f-497c-a3cb-ca12d67cd9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:04:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b61e31e-6baf-4b99-85e6-1bade5377a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b61e31e-6baf-4b99-85e6-1bade5377a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-853089909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=575f38fb-7677-43f1-b7c5-b964821b92b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09c96e5bb294cb6ad8702dfcbe271e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:04:25Z,use_quota=True,user_id='86b9d5a312d84ac789a8d0118f0b9dea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4db1b76-c8cb-48db-9832-1643777aa90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4db1b76-c8cb-48db-9832-1643777aa90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af125dc-3e90-474f-a8f5-9d575a71ccac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:25 devstack cinder-volume[82184]: DEBUG cinder.image.glance [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Creating Keystone auth plugin from conf {{(pid=82184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 02:04:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af125dc-3e90-474f-a8f5-9d575a71ccac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '575f38fb-7677-43f1-b7c5-b964821b92b9', 'volume_name': 'volume-575f38fb-7677-43f1-b7c5-b964821b92b9', 'volume_size': 1, 'image_id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b9740a9418bf48ba9dad196958886690', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'created_at': datetime.datetime(2026, 4, 20, 23, 58, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 23, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b22600ee-9d9f-4ee7-8886-ce18034d260d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4e1ec4-d388-4608-98a2-5cc53ef29651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4e1ec4-d388-4608-98a2-5cc53ef29651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38bd209-90f0-489d-865b-5466429fab77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:25 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Volume 575f38fb-7677-43f1-b7c5-b964821b92b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-575f38fb-7677-43f1-b7c5-b964821b92b9', 'volume_size': 1, 'image_id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b9740a9418bf48ba9dad196958886690', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'created_at': datetime.datetime(2026, 4, 20, 23, 58, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 23, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b22600ee-9d9f-4ee7-8886-ce18034d260d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 02:04:25 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Trying to clone 575f38fb-7677-43f1-b7c5-b964821b92b9 from image b22600ee-9d9f-4ee7-8886-ce18034d260d at location (None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}]). {{(pid=82184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 02:04:26 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__derxvzsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82184) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 02:04:26 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Image download 20.69 MB at 20.69 MB/s Apr 21 02:04:26 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[08711509-f875-41b6-9ee8-a81f44ccee36]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__derxvzsdevstack@QuobyteHD {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:26 devstack sudo[84337]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1 1G" returned: 0 in 1.810s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:26 devstack sudo[84370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1 Apr 21 02:04:26 devstack sudo[84370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:26 devstack sudo[84369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__derxvzsdevstack@QuobyteHD Apr 21 02:04:26 devstack sudo[84369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:27 devstack sudo[84370]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1" returned: 0 in 0.989s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:27 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 02:04:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:27 devstack sudo[84381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1 Apr 21 02:04:27 devstack sudo[84381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:27 devstack sudo[84369]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__derxvzsdevstack@QuobyteHD" returned: 0 in 1.077s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:27 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Temporary image b22600ee-9d9f-4ee7-8886-ce18034d260d is fetched for user 86b9d5a312d84ac789a8d0118f0b9dea. {{(pid=82184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 02:04:27 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3165c70-9051-4dd1-a4bb-488b1ddc2aba]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__derxvzsdevstack@QuobyteHD {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:27 devstack sudo[84383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__derxvzsdevstack@QuobyteHD Apr 21 02:04:27 devstack sudo[84383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:27 devstack sudo[84381]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1" returned: 0 in 0.563s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:28 devstack sudo[84386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.info Apr 21 02:04:28 devstack sudo[84386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:28 devstack sudo[84383]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__derxvzsdevstack@QuobyteHD" returned: 0 in 0.625s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:28 devstack sudo[84386]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.info" returned: 0 in 0.726s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:28 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 02:04:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:28 devstack sudo[84392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.info Apr 21 02:04:28 devstack sudo[84392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:29 devstack sudo[84392]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.info" returned: 0 in 0.458s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.678s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.087s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:29 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-853089909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=575f38fb-7677-43f1-b7c5-b964821b92b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09c96e5bb294cb6ad8702dfcbe271e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:04:25Z,use_quota=True,user_id='86b9d5a312d84ac789a8d0118f0b9dea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:04:29 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Creating volume 575f38fb-7677-43f1-b7c5-b964821b92b9 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:04:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:29 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:04:29 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:04:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:29 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:04:29 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:04:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:29 devstack sudo[84417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 1073741824 Apr 21 02:04:29 devstack sudo[84417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:29 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-3abbcc23-0944-492b-931b-bd7f611a636a tempest-GroupSnapshotsTest-2104303601 None] group_snapshot 2f27fc36-7585-4afb-875e-d031de00741c: created successfully Apr 21 02:04:30 devstack sudo[84417]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 1073741824" returned: 0 in 0.772s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:30 devstack sudo[84425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 Apr 21 02:04:30 devstack sudo[84425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:30 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] group_snapshot 2f27fc36-7585-4afb-875e-d031de00741c: deleting Apr 21 02:04:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] group_snapshot 2f27fc36-7585-4afb-875e-d031de00741c: deleting {{(pid=82184) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 02:04:30 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "cinder-quobyte-cd7ec11e-6e06-48c0-aea9-35fbebaff464" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:30 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-cd7ec11e-6e06-48c0-aea9-35fbebaff464" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:30 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "cinder-quobyte-350e5d3e-d900-4bfe-bdfe-115cf66603c1" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:30 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-350e5d3e-d900-4bfe-bdfe-115cf66603c1" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:30 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] Deleting offline snapshot 350e5d3e-d900-4bfe-bdfe-115cf66603c1 of volume cd7ec11e-6e06-48c0-aea9-35fbebaff464 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:04:30 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] snapshot_file for this snap is: volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:04:30 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[13181c25-4542-4b7f-ab71-2ccbe6ee79bf]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:30 devstack sudo[84428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1 Apr 21 02:04:30 devstack sudo[84428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:31 devstack sudo[84425]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9" returned: 0 in 0.934s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:04:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:31 devstack cinder-volume[82184]: DEBUG cinder.volume.volume_utils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Attempting download of b22600ee-9d9f-4ee7-8886-ce18034d260d ((None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}])) to volume 575f38fb-7677-43f1-b7c5-b964821b92b9. {{(pid=82184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 02:04:31 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0e1511-68ea-49bd-b1fe-6f2f751aaae7]: (4, 'raw') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_0unpv48h {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:31 devstack sudo[84437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_0unpv48h Apr 21 02:04:31 devstack sudo[84437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:31 devstack sudo[84428]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1" returned: 0 in 1.150s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:04:31 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e73e01-2191-4908-91e9-5cd194d67a56]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:31 devstack sudo[84442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464 Apr 21 02:04:31 devstack sudo[84442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:32 devstack sudo[84437]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_0unpv48h" returned: 0 in 1.147s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_0unpv48h {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:32 devstack sudo[84447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_0unpv48h Apr 21 02:04:32 devstack sudo[84447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Flow 'volume_create_manager' (22e54ecf-6cf3-4601-b3bd-8a47baa7627d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae76f9bd-7445-471f-849a-dce939d58515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae76f9bd-7445-471f-849a-dce939d58515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:04:32Z,deleted=False,deleted_at=None,display_description='',display_name='4f2c3af1-cf07-48a9-aa2f-5b0d5628917d-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69857c73-f416-4871-988f-18b0048b492c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585a2c0a56814d74b11b493cf99d9196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:04:33Z,use_quota=True,user_id='872833c13fca42f09e44b840cdbcf209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3ada6a-c0ad-4485-8919-72dd969e9deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3ada6a-c0ad-4485-8919-72dd969e9deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c8949b-bb3a-4bf5-9204-c330f23ed5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c8949b-bb3a-4bf5-9204-c330f23ed5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69857c73-f416-4871-988f-18b0048b492c', 'volume_name': 'volume-69857c73-f416-4871-988f-18b0048b492c', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4e0b32-a275-4f82-a768-7d8bf4a6f2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4e0b32-a275-4f82-a768-7d8bf4a6f2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4df99d3-c978-4f24-9911-92dc79969a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:32 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Volume 69857c73-f416-4871-988f-18b0048b492c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69857c73-f416-4871-988f-18b0048b492c', 'volume_size': 1} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:04:32Z,deleted=False,deleted_at=None,display_description='',display_name='4f2c3af1-cf07-48a9-aa2f-5b0d5628917d-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69857c73-f416-4871-988f-18b0048b492c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585a2c0a56814d74b11b493cf99d9196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:04:33Z,use_quota=True,user_id='872833c13fca42f09e44b840cdbcf209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Creating volume 69857c73-f416-4871-988f-18b0048b492c {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:04:32 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-69857c73-f416-4871-988f-18b0048b492c 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:32 devstack sudo[84452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-69857c73-f416-4871-988f-18b0048b492c 1073741824 Apr 21 02:04:32 devstack sudo[84452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:32 devstack sudo[84442]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464" returned: 0 in 1.483s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:33 devstack sudo[84456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1 Apr 21 02:04:33 devstack sudo[84456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:33 devstack sudo[84447]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_0unpv48h" returned: 1 in 1.183s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_0unpv48h' failed. Not Retrying. {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 02:04:33 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ca5bf6-bd44-4de6-a009-41ac34f77b8d]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__derxvzsdevstack@QuobyteHD {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:33 devstack sudo[84470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__derxvzsdevstack@QuobyteHD Apr 21 02:04:33 devstack sudo[84470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:33 devstack sudo[84452]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-69857c73-f416-4871-988f-18b0048b492c 1073741824" returned: 0 in 0.852s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-69857c73-f416-4871-988f-18b0048b492c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:33 devstack sudo[84475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-69857c73-f416-4871-988f-18b0048b492c Apr 21 02:04:33 devstack sudo[84475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:34 devstack sudo[84456]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1" returned: 0 in 1.069s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:34 devstack sudo[84477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1 Apr 21 02:04:34 devstack sudo[84477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:34 devstack sudo[84475]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-69857c73-f416-4871-988f-18b0048b492c" returned: 0 in 0.570s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:34 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:04:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:34 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4df99d3-c978-4f24-9911-92dc79969a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69857c73-f416-4871-988f-18b0048b492c', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:34 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2f4a59-b1a6-4c04-a6b1-cac6c75d78ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:34 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Volume volume-69857c73-f416-4871-988f-18b0048b492c (69857c73-f416-4871-988f-18b0048b492c): created successfully Apr 21 02:04:34 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2f4a59-b1a6-4c04-a6b1-cac6c75d78ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:34 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Flow 'volume_create_manager' (22e54ecf-6cf3-4601-b3bd-8a47baa7627d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:04:34 devstack cinder-volume[82184]: INFO cinder.volume.manager [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-3a11b19e-a71e-4259-a683-4c706e59be06 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Created volume successfully. Apr 21 02:04:34 devstack sudo[84470]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__derxvzsdevstack@QuobyteHD" returned: 0 in 1.189s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:34 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] b22600ee-9d9f-4ee7-8886-ce18034d260d was qcow2, converting to raw {{(pid=82184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 02:04:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__derxvzsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:34 devstack sudo[84510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__derxvzsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 Apr 21 02:04:34 devstack sudo[84510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:35 devstack sudo[84477]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464.350e5d3e-d900-4bfe-bdfe-115cf66603c1" returned: 0 in 1.024s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-350e5d3e-d900-4bfe-bdfe-115cf66603c1" released by "_delete_snapshot" :: held 4.949s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:04:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-cd7ec11e-6e06-48c0-aea9-35fbebaff464" released by "delete_snapshot" :: held 4.963s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:04:35 devstack cinder-volume[82184]: WARNING cinder.quota [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1122387914 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1122387914, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:04:35 devstack cinder-volume[82184]: WARNING cinder.quota [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1122387914 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1122387914, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:04:35 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] Created reservations ['e917c9a4-a334-43dc-a35c-7eacad30baa8', '5ef38a58-3383-4572-8e70-6ea63c260062', 'a1de7460-2fe4-43d0-a89f-f645b7530d12', '3b5e3f9e-7b85-4883-a7e6-081c48090e62'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:04:35 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-dd00b37e-046f-4afe-8c3c-2a483ae75dd2 tempest-GroupSnapshotsTest-2104303601 None] group_snapshot 2f27fc36-7585-4afb-875e-d031de00741c: deleted successfully Apr 21 02:04:36 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "cinder-quobyte-cd7ec11e-6e06-48c0-aea9-35fbebaff464" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:36 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-cd7ec11e-6e06-48c0-aea9-35fbebaff464" acquired by "delete_volume" :: waited 0.014s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:36 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbc98c0-2643-46f2-a30d-5e972b80c32d]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:36 devstack sudo[84530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464 Apr 21 02:04:36 devstack sudo[84530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-f9304270-6ccc-43eb-ace3-3041cce5c094 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-f9304270-6ccc-43eb-ace3-3041cce5c094 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:36 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7ad7fd-08ee-4123-aff8-d7181780bec0]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-f9304270-6ccc-43eb-ace3-3041cce5c094 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-69857c73-f416-4871-988f-18b0048b492c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:36 devstack sudo[84533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-69857c73-f416-4871-988f-18b0048b492c Apr 21 02:04:36 devstack sudo[84533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:37 devstack sudo[84530]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464" returned: 0 in 0.994s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:37 devstack sudo[84539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464 Apr 21 02:04:37 devstack sudo[84539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:37 devstack sudo[84510]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__derxvzsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9" returned: 0 in 2.668s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:37 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__derxvzsdevstack@QuobyteHD, size 112.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:04:37 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Converted 112.00 MB image at 41.96 MB/s Apr 21 02:04:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:37 devstack sudo[84542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 1G Apr 21 02:04:37 devstack sudo[84542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:37 devstack sudo[84533]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-f9304270-6ccc-43eb-ace3-3041cce5c094 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-69857c73-f416-4871-988f-18b0048b492c" returned: 0 in 1.210s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-f9304270-6ccc-43eb-ace3-3041cce5c094 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.224s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-f9304270-6ccc-43eb-ace3-3041cce5c094 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b', 'name': 'volume-69857c73-f416-4871-988f-18b0048b492c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0fcdb10b-0523-4e5d-988b-2b1105b40c01', 'enforce_multipath': True} {{(pid=82184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 21 02:04:37 devstack cinder-volume[82184]: INFO cinder.volume.manager [req-232bd9e3-6202-4a53-89a3-dde274a57cc9 req-f9304270-6ccc-43eb-ace3-3041cce5c094 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] attachment_update completed successfully. Apr 21 02:04:37 devstack sudo[84539]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd7ec11e-6e06-48c0-aea9-35fbebaff464" returned: 0 in 0.867s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] Lock "cinder-quobyte-cd7ec11e-6e06-48c0-aea9-35fbebaff464" released by "delete_volume" :: held 1.968s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] Created reservations ['434c36ab-abce-4208-9192-762b52c791c2'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:04:38 devstack cinder-volume[82184]: WARNING cinder.quota [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1122387914 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1122387914, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] Created reservations ['2d6950a5-f6e3-4e8a-9133-a2f8268c0165', '80426ed1-6e5b-48ca-9a52-7209eaff9cae', '807a551d-cdfc-49a4-ad4b-4907ca48f710', 'eeb297bc-525c-4ac9-9405-571b47258dec'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:38 devstack sudo[84574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:04:38 devstack sudo[84574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:38 devstack sudo[84542]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 1G" returned: 0 in 1.191s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f375b38-29e9-4938-b97c-238444a4d281]: (4, 'raw') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG oslo_service.periodic_task [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:38 devstack sudo[84578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:04:38 devstack sudo[84578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:38 devstack sudo[84577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 Apr 21 02:04:38 devstack sudo[84577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:38 devstack sudo[84574]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.784s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:39 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:04:39 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-fae2fb63-afe9-4f4d-83fe-defae41d0717 tempest-GroupSnapshotsTest-2104303601 None] Delete group completed successfully. Apr 21 02:04:40 devstack sudo[84577]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9" returned: 0 in 1.595s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:40 devstack sudo[84578]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 1.539s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:40 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:04:40 devstack sudo[84652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 Apr 21 02:04:40 devstack sudo[84652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:41 devstack sudo[84652]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9" returned: 1 in 0.930s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9' failed. Not Retrying. {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 02:04:41 devstack cinder-volume[82184]: DEBUG cinder.volume.volume_utils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Downloaded image b22600ee-9d9f-4ee7-8886-ce18034d260d ((None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}])) to volume 575f38fb-7677-43f1-b7c5-b964821b92b9 successfully. {{(pid=82184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 02:04:41 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Temporary image b22600ee-9d9f-4ee7-8886-ce18034d260d for user 86b9d5a312d84ac789a8d0118f0b9dea is deleted. {{(pid=82184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 02:04:41 devstack cinder-volume[82184]: DEBUG cinder.volume.volume_utils [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Marking volume 575f38fb-7677-43f1-b7c5-b964821b92b9 as bootable. {{(pid=82184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 02:04:41 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Copying metadata from image b22600ee-9d9f-4ee7-8886-ce18034d260d to 575f38fb-7677-43f1-b7c5-b964821b92b9. {{(pid=82184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 02:04:41 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Creating volume glance metadata for volume 575f38fb-7677-43f1-b7c5-b964821b92b9 backed by image b22600ee-9d9f-4ee7-8886-ce18034d260d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 02:04:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38bd209-90f0-489d-865b-5466429fab77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-575f38fb-7677-43f1-b7c5-b964821b92b9', 'volume_size': 1, 'image_id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b9740a9418bf48ba9dad196958886690', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'created_at': datetime.datetime(2026, 4, 20, 23, 58, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 23, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b22600ee-9d9f-4ee7-8886-ce18034d260d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb978181-f3d6-4c74-94e6-179806ed43cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:41 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Volume volume-575f38fb-7677-43f1-b7c5-b964821b92b9 (575f38fb-7677-43f1-b7c5-b964821b92b9): created successfully Apr 21 02:04:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb978181-f3d6-4c74-94e6-179806ed43cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Flow 'volume_create_manager' (5aedab21-af2f-497c-a3cb-ca12d67cd9c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:04:41 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-43802a7a-c78f-4cb0-8d5d-eb19fd1b7ea2 tempest-VolumesImageMetadata-1402996470 None] Created volume successfully. Apr 21 02:04:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] Acquiring lock "cinder-575f38fb-7677-43f1-b7c5-b964821b92b9-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] Lock "cinder-575f38fb-7677-43f1-b7c5-b964821b92b9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] Acquiring lock "cinder-quobyte-575f38fb-7677-43f1-b7c5-b964821b92b9" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] Lock "cinder-quobyte-575f38fb-7677-43f1-b7c5-b964821b92b9" acquired by "delete_volume" :: waited 0.048s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:43 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7263fac6-032c-4e38-a134-30450cc2d00e]: (4, 'raw') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:43 devstack sudo[85057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 Apr 21 02:04:43 devstack sudo[85057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:44 devstack sudo[85057]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9" returned: 0 in 1.077s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:44 devstack sudo[85074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 Apr 21 02:04:44 devstack sudo[85074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] Acquiring lock "cinder-5b5b9a51-5072-45ee-9e34-847ccbe944b8-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] Lock "cinder-5b5b9a51-5072-45ee-9e34-847ccbe944b8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] Acquiring lock "cinder-quobyte-5b5b9a51-5072-45ee-9e34-847ccbe944b8" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] Lock "cinder-quobyte-5b5b9a51-5072-45ee-9e34-847ccbe944b8" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:44 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c4a15d-7663-43b5-a9d9-1a7500e2d84c]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5b5b9a51-5072-45ee-9e34-847ccbe944b8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:45 devstack sudo[85078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5b5b9a51-5072-45ee-9e34-847ccbe944b8 Apr 21 02:04:45 devstack sudo[85078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:45 devstack sudo[85074]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9" returned: 1 in 1.378s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9' failed. Not Retrying. {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 02:04:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:45 devstack sudo[85084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9 Apr 21 02:04:45 devstack sudo[85084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:46 devstack sudo[85078]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5b5b9a51-5072-45ee-9e34-847ccbe944b8" returned: 0 in 1.285s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5b5b9a51-5072-45ee-9e34-847ccbe944b8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:46 devstack sudo[85093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5b5b9a51-5072-45ee-9e34-847ccbe944b8 Apr 21 02:04:46 devstack sudo[85093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:46 devstack sudo[85084]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-575f38fb-7677-43f1-b7c5-b964821b92b9" returned: 0 in 1.103s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] Lock "cinder-quobyte-575f38fb-7677-43f1-b7c5-b964821b92b9" released by "delete_volume" :: held 3.800s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:04:46 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] Created reservations ['954ff8a8-721c-41bc-a983-5b43c8df8546', '14ff4ca9-f21c-4528-be4b-9d0d042cd45e', '9264c9a2-c695-4a67-9a9f-2ba14608bf6d', 'e18779c5-dcfb-4891-8d1b-9c2e7d61a706'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:04:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:04:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:04:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:47 devstack sudo[85104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:04:47 devstack sudo[85104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:47 devstack sudo[85093]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5b5b9a51-5072-45ee-9e34-847ccbe944b8" returned: 0 in 0.971s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] Lock "cinder-quobyte-5b5b9a51-5072-45ee-9e34-847ccbe944b8" released by "delete_volume" :: held 2.360s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:04:47 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] Created reservations ['d75da0a9-63a0-4510-82d4-674f8556182d', 'cbddd8a7-301e-4734-a712-a7e1989cb153', '7a8e7210-bfe9-4120-a54c-131d47b1b7ae', '2730fc6a-4e0c-4c83-90e0-73456f1d9e4f'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:04:47 devstack cinder-volume[82184]: DEBUG oslo_db.api [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Apr 21 02:04:47 devstack cinder-volume[82184]: [SQL: SELECT reservations.id AS reservations_id, reservations.uuid AS reservations_uuid, reservations.usage_id AS reservations_usage_id, reservations.project_id AS reservations_project_id, reservations.resource AS reservations_resource, reservations.delta AS reservations_delta, reservations.expire AS reservations_expire, reservations.deleted_at AS reservations_deleted_at, reservations.deleted AS reservations_deleted, reservations.created_at AS reservations_created_at, reservations.updated_at AS reservations_updated_at Apr 21 02:04:47 devstack cinder-volume[82184]: FROM reservations Apr 21 02:04:47 devstack cinder-volume[82184]: WHERE reservations.deleted = false AND reservations.uuid IN (%(uuid_1_1)s, %(uuid_1_2)s, %(uuid_1_3)s, %(uuid_1_4)s) FOR UPDATE] Apr 21 02:04:47 devstack cinder-volume[82184]: [parameters: {'uuid_1_1': 'd75da0a9-63a0-4510-82d4-674f8556182d', 'uuid_1_2': 'cbddd8a7-301e-4734-a712-a7e1989cb153', 'uuid_1_3': '7a8e7210-bfe9-4120-a54c-131d47b1b7ae', 'uuid_1_4': '2730fc6a-4e0c-4c83-90e0-73456f1d9e4f'}] Apr 21 02:04:47 devstack cinder-volume[82184]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=82184) _is_exception_expected /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:184}} Apr 21 02:04:47 devstack cinder-volume[82184]: DEBUG oslo_db.api [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] Performing DB retry for function cinder.db.sqlalchemy.api.reservation_commit {{(pid=82184) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:155}} Apr 21 02:04:47 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-90d3590e-373a-4c86-936b-e184cf7a13da tempest-GroupSnapshotsV319Test-681631615 None] Group tempest-GroupSnapshotsV319Test-Group-830543307: creating Apr 21 02:04:47 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-90d3590e-373a-4c86-936b-e184cf7a13da tempest-GroupSnapshotsV319Test-681631615 None] Group tempest-GroupSnapshotsV319Test-Group-830543307: created successfully Apr 21 02:04:47 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-90d3590e-373a-4c86-936b-e184cf7a13da tempest-GroupSnapshotsV319Test-681631615 None] Create group completed successfully. Apr 21 02:04:48 devstack sudo[85104]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 1.005s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:48 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:04:48 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] Deleted volume successfully. Apr 21 02:04:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a5fde20d-6226-40be-b872-1b91d854a8da tempest-VolumesImageMetadata-1402996470 None] Lock "cinder-575f38fb-7677-43f1-b7c5-b964821b92b9-delete_volume" released by "delete_volume" :: held 5.254s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:04:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:04:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:04:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:48 devstack sudo[85123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:04:48 devstack sudo[85123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Flow 'volume_create_manager' (e674f674-56a3-487f-9f29-f3de67bbce5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad17d36-d28e-484d-a00c-a781c98b8fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad17d36-d28e-484d-a00c-a781c98b8fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-632345136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b307d751-7c77-45b1-80f2-61ed7ac200c5,host='devstack@QuobyteHD#QuobyteHD',id=576f2cb8-b0dc-4e62-b8ea-351f91570f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa6da68d4a64818957c13a95ec02dba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:04:49Z,use_quota=True,user_id='5265a558e3194c2ea463f93ff836e660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f0477a8-a6f7-4dd7-81b5-2dccd4346dd1),volume_type_id=3f0477a8-a6f7-4dd7-81b5-2dccd4346dd1)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5dda67a-d141-4206-83f0-b5789815189d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5dda67a-d141-4206-83f0-b5789815189d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21426948-bd4d-4956-9d2c-cd5977e93e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21426948-bd4d-4956-9d2c-cd5977e93e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '576f2cb8-b0dc-4e62-b8ea-351f91570f56', 'volume_name': 'volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d24be27-9bca-4a85-99c3-49572693b7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d24be27-9bca-4a85-99c3-49572693b7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779412a4-9689-4a3a-a889-94e68f8b004f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:49 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Volume 576f2cb8-b0dc-4e62-b8ea-351f91570f56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56', 'volume_size': 1} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b307d751-7c77-45b1-80f2-61ed7ac200c5,created_at=2026-04-21T00:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-632345136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b307d751-7c77-45b1-80f2-61ed7ac200c5,host='devstack@QuobyteHD#QuobyteHD',id=576f2cb8-b0dc-4e62-b8ea-351f91570f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa6da68d4a64818957c13a95ec02dba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:04:49Z,use_quota=True,user_id='5265a558e3194c2ea463f93ff836e660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f0477a8-a6f7-4dd7-81b5-2dccd4346dd1),volume_type_id=3f0477a8-a6f7-4dd7-81b5-2dccd4346dd1)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Creating volume 576f2cb8-b0dc-4e62-b8ea-351f91570f56 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:04:49 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:49 devstack sudo[85169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56 1073741824 Apr 21 02:04:49 devstack sudo[85169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:49 devstack sudo[85123]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 1.478s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:49 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:04:50 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] Deleted volume successfully. Apr 21 02:04:50 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7cad475a-bd9e-43bc-827c-db5170d36ad9 tempest-ServerRescueNegativeTestJSON-822049827 None] Lock "cinder-5b5b9a51-5072-45ee-9e34-847ccbe944b8-delete_volume" released by "delete_volume" :: held 5.318s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:04:51 devstack sudo[85169]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56 1073741824" returned: 0 in 1.878s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:51 devstack sudo[85200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56 Apr 21 02:04:51 devstack sudo[85200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:51 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:04:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Flow 'volume_create_manager' (4a7fb648-3105-4f10-84e7-86438046c86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:04:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0b885d-7bf1-40d7-a285-a9b0e00e902a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0b885d-7bf1-40d7-a285-a9b0e00e902a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-797757296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f30f376e-9d03-4600-ad9d-6c4aa1410fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5abf4b21c78d4fef8cea047f310508ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:04:52Z,use_quota=True,user_id='4560b37e9ed8483f8eb9a2a54c62f3b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe46aa3-dfa4-485b-9cca-2a68a69d80d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe46aa3-dfa4-485b-9cca-2a68a69d80d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b279bbd4-59d4-4509-9f18-2d213b8cec47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b279bbd4-59d4-4509-9f18-2d213b8cec47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f30f376e-9d03-4600-ad9d-6c4aa1410fcb', 'volume_name': 'volume-f30f376e-9d03-4600-ad9d-6c4aa1410fcb', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf023a77-e140-4051-ac67-a0abe0cc5fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf023a77-e140-4051-ac67-a0abe0cc5fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b3b810-0ccd-4cfb-981d-f498afc70c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:51 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Volume f30f376e-9d03-4600-ad9d-6c4aa1410fcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f30f376e-9d03-4600-ad9d-6c4aa1410fcb', 'volume_size': 1} Apr 21 02:04:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:52 devstack sudo[85200]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56" returned: 0 in 0.634s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] <== create_volume: return (2613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.619s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.373s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-797757296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f30f376e-9d03-4600-ad9d-6c4aa1410fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5abf4b21c78d4fef8cea047f310508ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:04:52Z,use_quota=True,user_id='4560b37e9ed8483f8eb9a2a54c62f3b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Creating volume f30f376e-9d03-4600-ad9d-6c4aa1410fcb {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:04:52 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f30f376e-9d03-4600-ad9d-6c4aa1410fcb 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779412a4-9689-4a3a-a889-94e68f8b004f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d156e4e-ceb7-48ea-ba26-3c71965cd37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:52 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Volume volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56 (576f2cb8-b0dc-4e62-b8ea-351f91570f56): created successfully Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d156e4e-ceb7-48ea-ba26-3c71965cd37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Flow 'volume_create_manager' (e674f674-56a3-487f-9f29-f3de67bbce5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:04:52 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-caa7e779-9d77-4082-9353-6eb9fc79595f tempest-GroupSnapshotsV319Test-681631615 None] Created volume successfully. Apr 21 02:04:52 devstack sudo[85203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f30f376e-9d03-4600-ad9d-6c4aa1410fcb 1073741824 Apr 21 02:04:52 devstack sudo[85203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:52 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] GroupSnapshot 7cf8f32a-8b0c-4ce8-8e23-81129bd00741: creating. Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] Group snapshot 7cf8f32a-8b0c-4ce8-8e23-81129bd00741: creating. {{(pid=82184) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:52 devstack sudo[85203]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f30f376e-9d03-4600-ad9d-6c4aa1410fcb 1073741824" returned: 0 in 0.662s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f30f376e-9d03-4600-ad9d-6c4aa1410fcb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:53 devstack sudo[85211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f30f376e-9d03-4600-ad9d-6c4aa1410fcb Apr 21 02:04:53 devstack sudo[85211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:53 devstack sudo[85211]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f30f376e-9d03-4600-ad9d-6c4aa1410fcb" returned: 0 in 0.428s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:53 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:04:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.592s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:53 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b3b810-0ccd-4cfb-981d-f498afc70c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f30f376e-9d03-4600-ad9d-6c4aa1410fcb', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:53 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b1918b-3d1d-4150-ab6e-648c4b246d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:53 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Volume volume-f30f376e-9d03-4600-ad9d-6c4aa1410fcb (f30f376e-9d03-4600-ad9d-6c4aa1410fcb): created successfully Apr 21 02:04:53 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b1918b-3d1d-4150-ab6e-648c4b246d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:53 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Flow 'volume_create_manager' (4a7fb648-3105-4f10-84e7-86438046c86e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:04:53 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-9dd7c93d-5313-42d9-ab77-52b54565f7d9 tempest-VolumesMetadataTest-1197174550 None] Created volume successfully. Apr 21 02:04:53 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] Creating offline snapshot 065aa9b8-0c84-46e3-83a2-93aa0f50a4de of volume 576f2cb8-b0dc-4e62-b8ea-351f91570f56 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:04:53 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6922f6a1-ccc4-48cb-be8e-ab07f8f215f7]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:53 devstack sudo[85220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56 Apr 21 02:04:53 devstack sudo[85220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:54 devstack sudo[85220]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56" returned: 0 in 0.628s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:54 devstack sudo[85245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de 1G Apr 21 02:04:54 devstack sudo[85245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:54 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] Acquiring lock "cinder-f30f376e-9d03-4600-ad9d-6c4aa1410fcb-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:54 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] Lock "cinder-f30f376e-9d03-4600-ad9d-6c4aa1410fcb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:54 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] Acquiring lock "cinder-quobyte-f30f376e-9d03-4600-ad9d-6c4aa1410fcb" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:54 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] Lock "cinder-quobyte-f30f376e-9d03-4600-ad9d-6c4aa1410fcb" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:54 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cc4e97-58f4-4009-b7db-df73a7e5353c]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f30f376e-9d03-4600-ad9d-6c4aa1410fcb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:54 devstack sudo[85248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f30f376e-9d03-4600-ad9d-6c4aa1410fcb Apr 21 02:04:54 devstack sudo[85248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:54 devstack sudo[85245]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de 1G" returned: 0 in 0.652s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:54 devstack sudo[85253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de Apr 21 02:04:54 devstack sudo[85253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:55 devstack sudo[85248]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f30f376e-9d03-4600-ad9d-6c4aa1410fcb" returned: 0 in 0.679s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f30f376e-9d03-4600-ad9d-6c4aa1410fcb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:55 devstack sudo[85263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f30f376e-9d03-4600-ad9d-6c4aa1410fcb Apr 21 02:04:55 devstack sudo[85263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:55 devstack sudo[85253]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de" returned: 0 in 0.540s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:55 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de is being set with open permissions: ugo+rw: NotImplementedError Apr 21 02:04:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:55 devstack sudo[85275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de Apr 21 02:04:55 devstack sudo[85275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:55 devstack sudo[85263]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f30f376e-9d03-4600-ad9d-6c4aa1410fcb" returned: 0 in 0.481s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] Lock "cinder-quobyte-f30f376e-9d03-4600-ad9d-6c4aa1410fcb" released by "delete_volume" :: held 1.185s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:04:55 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] Created reservations ['ff7ae998-e79e-4f45-9201-b3f7450eb963', 'd2048f1e-073e-4170-88f6-872b083df093', 'a6232420-ae51-40da-a25d-52c716b3c708', 'af427b23-516e-4d5e-9f4c-10ee086d47b0'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:04:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:04:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:04:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:55 devstack sudo[85287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:04:55 devstack sudo[85287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:56 devstack sudo[85275]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de" returned: 0 in 0.599s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:56 devstack sudo[85289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.info Apr 21 02:04:56 devstack sudo[85289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:56 devstack sudo[85287]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.517s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:56 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:04:56 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] Deleted volume successfully. Apr 21 02:04:56 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a176147a-f779-451c-8f15-a011bbb8611b tempest-VolumesMetadataTest-1197174550 None] Lock "cinder-f30f376e-9d03-4600-ad9d-6c4aa1410fcb-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:04:56 devstack sudo[85289]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.info" returned: 0 in 0.487s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:56 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 02:04:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:56 devstack sudo[85294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.info Apr 21 02:04:56 devstack sudo[85294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:56 devstack sudo[85294]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.info" returned: 0 in 0.479s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.544s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:57 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-db8277d5-1020-4b3d-9d67-80eba0bd94f2 tempest-GroupSnapshotsV319Test-681631615 None] group_snapshot 7cf8f32a-8b0c-4ce8-8e23-81129bd00741: created successfully Apr 21 02:04:58 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] group_snapshot 7cf8f32a-8b0c-4ce8-8e23-81129bd00741: deleting Apr 21 02:04:58 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] group_snapshot 7cf8f32a-8b0c-4ce8-8e23-81129bd00741: deleting {{(pid=82184) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 02:04:58 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] Acquiring lock "cinder-quobyte-576f2cb8-b0dc-4e62-b8ea-351f91570f56" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:58 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] Lock "cinder-quobyte-576f2cb8-b0dc-4e62-b8ea-351f91570f56" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:58 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] Acquiring lock "cinder-quobyte-065aa9b8-0c84-46e3-83a2-93aa0f50a4de" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:04:58 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] Lock "cinder-quobyte-065aa9b8-0c84-46e3-83a2-93aa0f50a4de" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:04:58 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] Deleting offline snapshot 065aa9b8-0c84-46e3-83a2-93aa0f50a4de of volume 576f2cb8-b0dc-4e62-b8ea-351f91570f56 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:04:58 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] snapshot_file for this snap is: volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:04:58 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c370d0-20db-4c9d-ba5b-743e527d61e6]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:58 devstack sudo[85337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de Apr 21 02:04:58 devstack sudo[85337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:59 devstack sudo[85337]: pam_unix(sudo:session): session closed for user root Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de" returned: 0 in 0.816s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e0bb6c-61fe-41cc-9cae-29261080eaae]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:59 devstack sudo[85344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56 Apr 21 02:04:59 devstack sudo[85344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Flow 'volume_create_manager' (fc5bd84b-15ff-4d57-98c1-30ab2e16d6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466b9d0d-9a8c-45e1-b806-67476ab425a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466b9d0d-9a8c-45e1-b806-67476ab425a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-588605706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e2aa9a-f392-4870-8f8a-0d0d55a9099f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='654dac74df9e403fb50c47a1ac772d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:00Z,use_quota=True,user_id='c28384cebf0a438bbeedb7220cfff027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34548a5-d2dc-46d6-9ad4-26918097d37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34548a5-d2dc-46d6-9ad4-26918097d37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e176fb3-0308-4d62-b5a5-2c3f98cf754e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e176fb3-0308-4d62-b5a5-2c3f98cf754e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5e2aa9a-f392-4870-8f8a-0d0d55a9099f', 'volume_name': 'volume-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e07564c-b8a6-485b-983a-a95bbc7d19b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e07564c-b8a6-485b-983a-a95bbc7d19b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6430fd5b-f138-4b62-957f-2fa6e97db7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:04:59 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Volume f5e2aa9a-f392-4870-8f8a-0d0d55a9099f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f', 'volume_size': 1} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-588605706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e2aa9a-f392-4870-8f8a-0d0d55a9099f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='654dac74df9e403fb50c47a1ac772d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:00Z,use_quota=True,user_id='c28384cebf0a438bbeedb7220cfff027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Creating volume f5e2aa9a-f392-4870-8f8a-0d0d55a9099f {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:04:59 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:04:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:04:59 devstack sudo[85363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f 1073741824 Apr 21 02:04:59 devstack sudo[85363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:00 devstack sudo[85344]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56" returned: 0 in 0.738s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:00 devstack sudo[85402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de Apr 21 02:05:00 devstack sudo[85402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:00 devstack sudo[85363]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f 1073741824" returned: 0 in 0.798s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:00 devstack sudo[85410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f Apr 21 02:05:00 devstack sudo[85410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:00 devstack sudo[85402]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de" returned: 0 in 0.772s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:00 devstack sudo[85415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de Apr 21 02:05:00 devstack sudo[85415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:01 devstack sudo[85410]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f" returned: 0 in 0.457s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:05:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6430fd5b-f138-4b62-957f-2fa6e97db7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2982f9a-64cc-47e7-a672-8fb1917d0eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:01 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Volume volume-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f (f5e2aa9a-f392-4870-8f8a-0d0d55a9099f): created successfully Apr 21 02:05:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2982f9a-64cc-47e7-a672-8fb1917d0eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Flow 'volume_create_manager' (fc5bd84b-15ff-4d57-98c1-30ab2e16d6c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:01 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-9d04aee6-032d-4242-9d79-1437f75ef98b tempest-VolumesTransfersV355Test-150759680 None] Created volume successfully. Apr 21 02:05:01 devstack sudo[85415]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56.065aa9b8-0c84-46e3-83a2-93aa0f50a4de" returned: 0 in 0.451s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:01 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] Lock "cinder-quobyte-065aa9b8-0c84-46e3-83a2-93aa0f50a4de" released by "_delete_snapshot" :: held 2.850s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:01 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] Lock "cinder-quobyte-576f2cb8-b0dc-4e62-b8ea-351f91570f56" released by "delete_snapshot" :: held 2.860s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:01 devstack cinder-volume[82184]: WARNING cinder.quota [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-308637735 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-308637735, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:05:01 devstack cinder-volume[82184]: WARNING cinder.quota [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-308637735 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-308637735, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:05:01 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] Created reservations ['148448d9-d6ee-4a68-9669-e6053877309a', '26dbdee7-e353-4d78-b374-a7030f6d9f54', '95c5c160-3319-4d03-9650-b60a38c6b109', 'e11f138e-9fa8-4929-9345-35f14275269e'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:05:01 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-2df9e34c-c377-4874-b62c-b30d5886747a tempest-GroupSnapshotsV319Test-681631615 None] group_snapshot 7cf8f32a-8b0c-4ce8-8e23-81129bd00741: deleted successfully Apr 21 02:05:01 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] Acquiring lock "cinder-quobyte-576f2cb8-b0dc-4e62-b8ea-351f91570f56" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:01 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] Lock "cinder-quobyte-576f2cb8-b0dc-4e62-b8ea-351f91570f56" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:01 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f7eb33-ecfb-4220-b3c1-cdd15a11de72]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:01 devstack sudo[85421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56 Apr 21 02:05:01 devstack sudo[85421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:02 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-886bdb9d-b203-4526-92e2-2bb63ebf4be4 tempest-VolumesTransfersV355Test-1630662901 None] Transfer volume completed successfully. Apr 21 02:05:02 devstack sudo[85421]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56" returned: 0 in 0.581s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:02 devstack sudo[85426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56 Apr 21 02:05:02 devstack sudo[85426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:03 devstack sudo[85426]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-576f2cb8-b0dc-4e62-b8ea-351f91570f56" returned: 0 in 0.654s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] Lock "cinder-quobyte-576f2cb8-b0dc-4e62-b8ea-351f91570f56" released by "delete_volume" :: held 1.285s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] Created reservations ['4010be9f-a3fa-48af-889a-85a7203088c1'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:05:03 devstack cinder-volume[82184]: WARNING cinder.quota [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-308637735 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-308637735, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] Created reservations ['1740de49-5f30-48fb-8523-032f6dd4a16a', '191c1e41-3b5e-4aad-8470-f6cfc654fa20', '47b9b073-6216-4d6a-9002-21a17312fd9e', 'd4cbb579-681e-4a13-808e-4b2f6af55c0e'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] Acquiring lock "cinder-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] Lock "cinder-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:03 devstack sudo[85429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:05:03 devstack sudo[85429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] Acquiring lock "cinder-quobyte-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] Lock "cinder-quobyte-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[291c81c9-3a06-41f4-a57b-81faca8893ac]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:03 devstack sudo[85431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f Apr 21 02:05:03 devstack sudo[85431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:03 devstack sudo[85429]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.547s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:05:03 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-4a0ed042-5f07-4d34-bf21-0708504c7e26 tempest-GroupSnapshotsV319Test-681631615 None] Delete group completed successfully. Apr 21 02:05:03 devstack sudo[85431]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f" returned: 0 in 0.553s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:03 devstack sudo[85438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f Apr 21 02:05:03 devstack sudo[85438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:04 devstack sudo[85438]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f" returned: 0 in 0.588s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] Lock "cinder-quobyte-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f" released by "delete_volume" :: held 1.161s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:04 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] Created reservations ['be7c1013-b9b1-42db-89a1-9b512672ebac', '6c4e4acf-0b04-4dee-8f21-52d4a1efca25', '23b9dbff-67ea-47a4-8480-d9021315840f', '90170833-3b05-44f3-85cc-ff3476087ecb'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:05:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:04 devstack sudo[85467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:05:04 devstack sudo[85467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:05 devstack sudo[85467]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.549s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:05 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:05:05 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] Deleted volume successfully. Apr 21 02:05:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3e14b17a-cc39-47b8-9702-eeaffa43ae6d tempest-VolumesTransfersV355Test-775552027 None] Lock "cinder-f5e2aa9a-f392-4870-8f8a-0d0d55a9099f-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Flow 'volume_create_manager' (d74bca13-ea48-473c-be71-294f035279e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfe340e-4ce7-474e-ac3f-b4931724a69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfe340e-4ce7-474e-ac3f-b4931724a69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1143212939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9322e263-bbfa-4758-858e-8414f47f64a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='654dac74df9e403fb50c47a1ac772d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:06Z,use_quota=True,user_id='c28384cebf0a438bbeedb7220cfff027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ef70e2-1648-4ffe-b5e7-9bf5b563b771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ef70e2-1648-4ffe-b5e7-9bf5b563b771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df83f0c-8551-4f5f-a0d6-5f2011881523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df83f0c-8551-4f5f-a0d6-5f2011881523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9322e263-bbfa-4758-858e-8414f47f64a0', 'volume_name': 'volume-9322e263-bbfa-4758-858e-8414f47f64a0', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7f3f31-2bb8-43a0-b1a9-856587816f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7f3f31-2bb8-43a0-b1a9-856587816f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe68cb4-3a88-4783-a89c-14d2605f00fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:06 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Volume 9322e263-bbfa-4758-858e-8414f47f64a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9322e263-bbfa-4758-858e-8414f47f64a0', 'volume_size': 1} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1143212939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9322e263-bbfa-4758-858e-8414f47f64a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='654dac74df9e403fb50c47a1ac772d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:06Z,use_quota=True,user_id='c28384cebf0a438bbeedb7220cfff027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Creating volume 9322e263-bbfa-4758-858e-8414f47f64a0 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:05:06 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9322e263-bbfa-4758-858e-8414f47f64a0 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:06 devstack sudo[85494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9322e263-bbfa-4758-858e-8414f47f64a0 1073741824 Apr 21 02:05:06 devstack sudo[85494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:06 devstack sudo[85494]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9322e263-bbfa-4758-858e-8414f47f64a0 1073741824" returned: 0 in 0.550s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9322e263-bbfa-4758-858e-8414f47f64a0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:06 devstack sudo[85502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9322e263-bbfa-4758-858e-8414f47f64a0 Apr 21 02:05:06 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:07 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9322e263-bbfa-4758-858e-8414f47f64a0" returned: 0 in 0.515s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:07 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:05:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe68cb4-3a88-4783-a89c-14d2605f00fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9322e263-bbfa-4758-858e-8414f47f64a0', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc3e5b0-9344-4ef5-aead-06561b122b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:07 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Volume volume-9322e263-bbfa-4758-858e-8414f47f64a0 (9322e263-bbfa-4758-858e-8414f47f64a0): created successfully Apr 21 02:05:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc3e5b0-9344-4ef5-aead-06561b122b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Flow 'volume_create_manager' (d74bca13-ea48-473c-be71-294f035279e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:07 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-4ec1dfd3-05e6-4eb0-89a0-7ae14899f777 tempest-VolumesTransfersV355Test-150759680 None] Created volume successfully. Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] Acquiring lock "cinder-9322e263-bbfa-4758-858e-8414f47f64a0-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] Lock "cinder-9322e263-bbfa-4758-858e-8414f47f64a0-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:UPDATE=146,cinder:DELETE=5,cinder:SELECT=133,cinder:INSERT=43 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:UPDATE=133,cinder:SELECT=122,cinder:INSERT=35,cinder:DELETE=9 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] Acquiring lock "cinder-quobyte-9322e263-bbfa-4758-858e-8414f47f64a0" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] Lock "cinder-quobyte-9322e263-bbfa-4758-858e-8414f47f64a0" acquired by "delete_volume" :: waited 0.030s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c2307f-8c4d-4851-b5ea-e4a47731dd58]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9322e263-bbfa-4758-858e-8414f47f64a0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:08 devstack sudo[85509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9322e263-bbfa-4758-858e-8414f47f64a0 Apr 21 02:05:08 devstack sudo[85509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Flow 'volume_create_manager' (dffb1d00-f228-431c-ab8a-4754e6c174e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c366fff-adcd-49f3-a863-20aca27715a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c366fff-adcd-49f3-a863-20aca27715a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1877032729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfaed162-c84d-4934-8b59-b0f02e190b52,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d11c7e1686246a98b1d50f3f97fd136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:09Z,use_quota=True,user_id='82669f5cca54473694eada64c7334089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e0d401-035a-4a36-87b6-06d2b4d3d050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e0d401-035a-4a36-87b6-06d2b4d3d050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdd2b0e-d565-4629-ae91-6ac41c617171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdd2b0e-d565-4629-ae91-6ac41c617171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfaed162-c84d-4934-8b59-b0f02e190b52', 'volume_name': 'volume-dfaed162-c84d-4934-8b59-b0f02e190b52', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3dbea2-5f98-4d0a-9de5-8e7799587acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3dbea2-5f98-4d0a-9de5-8e7799587acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c13c9b5-c4be-4518-b159-e6c9281ad465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:08 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Volume dfaed162-c84d-4934-8b59-b0f02e190b52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfaed162-c84d-4934-8b59-b0f02e190b52', 'volume_size': 1} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1877032729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfaed162-c84d-4934-8b59-b0f02e190b52,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d11c7e1686246a98b1d50f3f97fd136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:09Z,use_quota=True,user_id='82669f5cca54473694eada64c7334089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Creating volume dfaed162-c84d-4934-8b59-b0f02e190b52 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:05:08 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:05:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dfaed162-c84d-4934-8b59-b0f02e190b52 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:09 devstack sudo[85516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dfaed162-c84d-4934-8b59-b0f02e190b52 1073741824 Apr 21 02:05:09 devstack sudo[85516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:09 devstack sudo[85509]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9322e263-bbfa-4758-858e-8414f47f64a0" returned: 0 in 0.620s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9322e263-bbfa-4758-858e-8414f47f64a0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:09 devstack sudo[85518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9322e263-bbfa-4758-858e-8414f47f64a0 Apr 21 02:05:09 devstack sudo[85518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:09 devstack sudo[85516]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dfaed162-c84d-4934-8b59-b0f02e190b52 1073741824" returned: 0 in 0.490s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dfaed162-c84d-4934-8b59-b0f02e190b52 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:09 devstack sudo[85518]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9322e263-bbfa-4758-858e-8414f47f64a0" returned: 0 in 0.438s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:09 devstack sudo[85524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dfaed162-c84d-4934-8b59-b0f02e190b52 Apr 21 02:05:09 devstack sudo[85524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:09 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] Lock "cinder-quobyte-9322e263-bbfa-4758-858e-8414f47f64a0" released by "delete_volume" :: held 1.089s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:09 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] Created reservations ['7227d4ec-acce-454f-9ef7-71bbd1b8f276', '956aadb8-b684-430a-9081-897c06f81d1a', 'dc8d4d6e-4189-4d66-a097-b8a6527bf114', '0355f887-62da-41d2-8c07-35f5fb148277'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:05:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:09 devstack sudo[85526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:05:09 devstack sudo[85526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:09 devstack sudo[85524]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dfaed162-c84d-4934-8b59-b0f02e190b52" returned: 0 in 0.458s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:05:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c13c9b5-c4be-4518-b159-e6c9281ad465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfaed162-c84d-4934-8b59-b0f02e190b52', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf7fd0f-de40-436c-bdb7-e948907bfb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:10 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Volume volume-dfaed162-c84d-4934-8b59-b0f02e190b52 (dfaed162-c84d-4934-8b59-b0f02e190b52): created successfully Apr 21 02:05:10 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf7fd0f-de40-436c-bdb7-e948907bfb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:10 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Flow 'volume_create_manager' (dffb1d00-f228-431c-ab8a-4754e6c174e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:10 devstack cinder-volume[82184]: INFO cinder.volume.manager [req-7683469e-86fd-4f79-b7aa-343cf324ce1e req-b48b3944-9722-4235-ae31-855c2d2305aa tempest-VolumesGetTestJSON-387973588 None] Created volume successfully. Apr 21 02:05:10 devstack sudo[85526]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.494s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:10 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:05:10 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] Deleted volume successfully. Apr 21 02:05:10 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1d92dd6b-1f99-422a-a979-82b3b08c91ed tempest-VolumesTransfersV355Test-775552027 None] Lock "cinder-9322e263-bbfa-4758-858e-8414f47f64a0-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:11 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] Acquiring lock "cinder-dfaed162-c84d-4934-8b59-b0f02e190b52-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:11 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] Lock "cinder-dfaed162-c84d-4934-8b59-b0f02e190b52-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:11 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] Acquiring lock "cinder-quobyte-dfaed162-c84d-4934-8b59-b0f02e190b52" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:11 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] Lock "cinder-quobyte-dfaed162-c84d-4934-8b59-b0f02e190b52" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:11 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f32348e-73e5-454e-a393-fdc490a875c2]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dfaed162-c84d-4934-8b59-b0f02e190b52 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:11 devstack sudo[85530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dfaed162-c84d-4934-8b59-b0f02e190b52 Apr 21 02:05:11 devstack sudo[85530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:12 devstack sudo[85530]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dfaed162-c84d-4934-8b59-b0f02e190b52" returned: 0 in 0.621s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dfaed162-c84d-4934-8b59-b0f02e190b52 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:12 devstack sudo[85537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dfaed162-c84d-4934-8b59-b0f02e190b52 Apr 21 02:05:12 devstack sudo[85537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:12 devstack sudo[85537]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dfaed162-c84d-4934-8b59-b0f02e190b52" returned: 0 in 0.526s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:12 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] Lock "cinder-quobyte-dfaed162-c84d-4934-8b59-b0f02e190b52" released by "delete_volume" :: held 1.169s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:12 devstack cinder-volume[82184]: DEBUG cinder.quota [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] Created reservations ['ed2b4bf9-5ec1-4e12-aeba-d5a33a272129', '5a99cafc-640c-4f1f-acb7-1375d90bda8b', '44c15b2c-00c3-4fc0-bdcb-3f951f883523', 'd67aa641-2857-49f2-9308-94fc5d8d43ec'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:05:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:12 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:12 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:12 devstack sudo[85540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:05:12 devstack sudo[85540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:13 devstack sudo[85540]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.490s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:13 devstack cinder-volume[82184]: DEBUG cinder.manager [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:05:13 devstack cinder-volume[82184]: INFO cinder.volume.manager [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] Deleted volume successfully. Apr 21 02:05:13 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-9d2ee9e4-9e9d-43e4-a657-034896e238a7 req-cdda8bcc-8160-4ae5-bb67-b6fb8dab2809 tempest-VolumesGetTestJSON-387973588 None] Lock "cinder-dfaed162-c84d-4934-8b59-b0f02e190b52-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Flow 'volume_create_manager' (cd024afe-e0a9-43d6-9a49-155fab838e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c3cb6e-398b-41d8-ab52-c232d05352cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c3cb6e-398b-41d8-ab52-c232d05352cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1419551677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e638c59-5cc8-4feb-b23e-ecd9ed38a234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9a25b5671e4332a959998cb4956a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:17Z,use_quota=True,user_id='6d79dd2d39234d80bed6a1a1b436d426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4948ea6e-0959-496f-8440-68d845d2a26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4948ea6e-0959-496f-8440-68d845d2a26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816c7bdd-4ebb-40f3-b066-be8fad0513c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816c7bdd-4ebb-40f3-b066-be8fad0513c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e638c59-5cc8-4feb-b23e-ecd9ed38a234', 'volume_name': 'volume-9e638c59-5cc8-4feb-b23e-ecd9ed38a234', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429e8649-e294-4d88-88e6-8152c4feaecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429e8649-e294-4d88-88e6-8152c4feaecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e904258-68b7-4fd8-92c2-0047471e6853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:16 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Volume 9e638c59-5cc8-4feb-b23e-ecd9ed38a234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e638c59-5cc8-4feb-b23e-ecd9ed38a234', 'volume_size': 1} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1419551677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e638c59-5cc8-4feb-b23e-ecd9ed38a234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9a25b5671e4332a959998cb4956a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:17Z,use_quota=True,user_id='6d79dd2d39234d80bed6a1a1b436d426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Creating volume 9e638c59-5cc8-4feb-b23e-ecd9ed38a234 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:05:16 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9e638c59-5cc8-4feb-b23e-ecd9ed38a234 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:16 devstack sudo[85562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9e638c59-5cc8-4feb-b23e-ecd9ed38a234 1073741824 Apr 21 02:05:16 devstack sudo[85562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Flow 'volume_create_manager' (6511aae5-40cb-4bea-9baa-9b1bf8f053a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b2b8d9-b4a8-43ad-9166-cdc0feb08951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b2b8d9-b4a8-43ad-9166-cdc0feb08951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1915321672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fc3b8a-9a52-4e70-82d0-e6fcb503478d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c91a9cd965946128f84da6b2f44d141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:17Z,use_quota=True,user_id='bcfa0844e7304ada919a0a308cc7cbbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee36a535-7569-4092-ae05-841405544b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee36a535-7569-4092-ae05-841405544b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3eb322-a10a-4c59-a169-3150d814b599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3eb322-a10a-4c59-a169-3150d814b599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9fc3b8a-9a52-4e70-82d0-e6fcb503478d', 'volume_name': 'volume-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9015c8-fc0e-4309-a5ad-da711f14a97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9015c8-fc0e-4309-a5ad-da711f14a97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c05dac7-a47d-473f-8731-25507c0fed23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:17 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Volume a9fc3b8a-9a52-4e70-82d0-e6fcb503478d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d', 'volume_size': 1} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:17 devstack sudo[85562]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9e638c59-5cc8-4feb-b23e-ecd9ed38a234 1073741824" returned: 0 in 0.553s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9e638c59-5cc8-4feb-b23e-ecd9ed38a234 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:17 devstack sudo[85567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9e638c59-5cc8-4feb-b23e-ecd9ed38a234 Apr 21 02:05:17 devstack sudo[85567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:17 devstack sudo[85567]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9e638c59-5cc8-4feb-b23e-ecd9ed38a234" returned: 0 in 0.434s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.646s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1915321672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fc3b8a-9a52-4e70-82d0-e6fcb503478d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c91a9cd965946128f84da6b2f44d141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:17Z,use_quota=True,user_id='bcfa0844e7304ada919a0a308cc7cbbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Creating volume a9fc3b8a-9a52-4e70-82d0-e6fcb503478d {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:05:17 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e904258-68b7-4fd8-92c2-0047471e6853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e638c59-5cc8-4feb-b23e-ecd9ed38a234', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ae6727-7fe9-49e9-93b1-831c94823820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:17 devstack sudo[85573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d 1073741824 Apr 21 02:05:17 devstack sudo[85573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:17 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Volume volume-9e638c59-5cc8-4feb-b23e-ecd9ed38a234 (9e638c59-5cc8-4feb-b23e-ecd9ed38a234): created successfully Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ae6727-7fe9-49e9-93b1-831c94823820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Flow 'volume_create_manager' (cd024afe-e0a9-43d6-9a49-155fab838e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:17 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-6122790a-fb76-4491-9cb9-feea0acfef9e tempest-VolumesTransfersV357Test-752679062 None] Created volume successfully. Apr 21 02:05:18 devstack sudo[85573]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d 1073741824" returned: 0 in 0.662s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:18 devstack sudo[85578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d Apr 21 02:05:18 devstack sudo[85578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:18 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-dddeffd1-d2c9-4ae2-b3a2-92af9455c00b tempest-VolumesTransfersV357Test-1628490698 None] Transfer volume completed successfully. Apr 21 02:05:18 devstack sudo[85578]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d" returned: 0 in 0.463s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:05:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c05dac7-a47d-473f-8731-25507c0fed23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390c5af5-207d-4a2a-a82c-9b24b7ce437d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:18 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Volume volume-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d (a9fc3b8a-9a52-4e70-82d0-e6fcb503478d): created successfully Apr 21 02:05:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390c5af5-207d-4a2a-a82c-9b24b7ce437d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Flow 'volume_create_manager' (6511aae5-40cb-4bea-9baa-9b1bf8f053a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:18 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-178dd96d-aa63-4549-934d-7ca6b82e5a49 tempest-VolumesTestJSON-1326838682 None] Created volume successfully. Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] Acquiring lock "cinder-9e638c59-5cc8-4feb-b23e-ecd9ed38a234-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] Lock "cinder-9e638c59-5cc8-4feb-b23e-ecd9ed38a234-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] Acquiring lock "cinder-quobyte-9e638c59-5cc8-4feb-b23e-ecd9ed38a234" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] Lock "cinder-quobyte-9e638c59-5cc8-4feb-b23e-ecd9ed38a234" acquired by "delete_volume" :: waited 0.019s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa371ef-d5fb-47c1-80ab-2fad2b6eb709]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9e638c59-5cc8-4feb-b23e-ecd9ed38a234 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:05:19 devstack sudo[85609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9e638c59-5cc8-4feb-b23e-ecd9ed38a234 Apr 21 02:05:19 devstack sudo[85609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Flow 'volume_create_manager' (0a4c718a-a1a3-4d6f-98ff-d1f39553775a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8921778d-d6a4-42d0-b251-2d485a26e2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8921778d-d6a4-42d0-b251-2d485a26e2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1393443725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9671de0-58cc-4b3c-82e5-47719a8bb694,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c91a9cd965946128f84da6b2f44d141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:20Z,use_quota=True,user_id='bcfa0844e7304ada919a0a308cc7cbbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ba6f4a-eb5b-4a52-a441-2229dbd53c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ba6f4a-eb5b-4a52-a441-2229dbd53c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af6093f-af1f-48be-9391-3bc53d1a8975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af6093f-af1f-48be-9391-3bc53d1a8975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9671de0-58cc-4b3c-82e5-47719a8bb694', 'volume_name': 'volume-f9671de0-58cc-4b3c-82e5-47719a8bb694', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81845c8-e083-46ed-b9b7-1b10f7be2813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81845c8-e083-46ed-b9b7-1b10f7be2813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c192d746-a36a-403e-8749-807b2001db0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:19 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Volume f9671de0-58cc-4b3c-82e5-47719a8bb694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9671de0-58cc-4b3c-82e5-47719a8bb694', 'volume_size': 1} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1393443725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9671de0-58cc-4b3c-82e5-47719a8bb694,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c91a9cd965946128f84da6b2f44d141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:20Z,use_quota=True,user_id='bcfa0844e7304ada919a0a308cc7cbbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Creating volume f9671de0-58cc-4b3c-82e5-47719a8bb694 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:05:19 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:05:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f9671de0-58cc-4b3c-82e5-47719a8bb694 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:20 devstack sudo[85611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f9671de0-58cc-4b3c-82e5-47719a8bb694 1073741824 Apr 21 02:05:20 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:20 devstack sudo[85609]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9e638c59-5cc8-4feb-b23e-ecd9ed38a234" returned: 0 in 0.810s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9e638c59-5cc8-4feb-b23e-ecd9ed38a234 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:20 devstack sudo[85620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9e638c59-5cc8-4feb-b23e-ecd9ed38a234 Apr 21 02:05:20 devstack sudo[85620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:20 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f9671de0-58cc-4b3c-82e5-47719a8bb694 1073741824" returned: 0 in 0.902s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f9671de0-58cc-4b3c-82e5-47719a8bb694 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:20 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f9671de0-58cc-4b3c-82e5-47719a8bb694 Apr 21 02:05:20 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:21 devstack sudo[85620]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9e638c59-5cc8-4feb-b23e-ecd9ed38a234" returned: 0 in 0.684s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] Lock "cinder-quobyte-9e638c59-5cc8-4feb-b23e-ecd9ed38a234" released by "delete_volume" :: held 1.537s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:21 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] Created reservations ['323f91ef-851d-4f3d-b821-3300c85e82a3', '433bdf5c-5c33-4ff3-b130-33ab4071faaf', '008ce703-845e-446a-839d-f35b0bf2b8cc', '97a2738c-bda2-4bc6-b942-55e4c4f62b12'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:05:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:21 devstack sudo[85625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:05:21 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:21 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f9671de0-58cc-4b3c-82e5-47719a8bb694" returned: 0 in 0.585s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:05:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c192d746-a36a-403e-8749-807b2001db0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9671de0-58cc-4b3c-82e5-47719a8bb694', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227ecc0d-b14c-4bdf-9d7b-8c508830c3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:21 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Volume volume-f9671de0-58cc-4b3c-82e5-47719a8bb694 (f9671de0-58cc-4b3c-82e5-47719a8bb694): created successfully Apr 21 02:05:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227ecc0d-b14c-4bdf-9d7b-8c508830c3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Flow 'volume_create_manager' (0a4c718a-a1a3-4d6f-98ff-d1f39553775a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:21 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-c3032aad-90f6-4377-8d58-2d6075adb567 tempest-VolumesTestJSON-1326838682 None] Created volume successfully. Apr 21 02:05:22 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.838s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:05:22 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] Deleted volume successfully. Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-458ac39a-bbc2-4a11-994d-897a8eeced60 tempest-VolumesTransfersV357Test-828505501 None] Lock "cinder-9e638c59-5cc8-4feb-b23e-ecd9ed38a234-delete_volume" released by "delete_volume" :: held 2.594s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Flow 'volume_create_manager' (fac29a11-8857-4098-818e-78cadc17ecba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b6450e-85d3-4306-961c-6a745c6a1ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b6450e-85d3-4306-961c-6a745c6a1ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1314934540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207ddfb6-e4c6-40d9-91bc-d55e77a52c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9a25b5671e4332a959998cb4956a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:22Z,use_quota=True,user_id='6d79dd2d39234d80bed6a1a1b436d426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e162f6-5629-4e88-95a8-15797e4c2839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e162f6-5629-4e88-95a8-15797e4c2839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d251d298-b58d-42e3-b0b4-1507ae9807d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d251d298-b58d-42e3-b0b4-1507ae9807d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '207ddfb6-e4c6-40d9-91bc-d55e77a52c7d', 'volume_name': 'volume-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f61677-c540-4727-bd7f-7c87a362a456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f61677-c540-4727-bd7f-7c87a362a456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108b4011-bded-4de8-97e3-beba9b74f1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:22 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Volume 207ddfb6-e4c6-40d9-91bc-d55e77a52c7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d', 'volume_size': 1} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1314934540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207ddfb6-e4c6-40d9-91bc-d55e77a52c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9a25b5671e4332a959998cb4956a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:22Z,use_quota=True,user_id='6d79dd2d39234d80bed6a1a1b436d426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Creating volume 207ddfb6-e4c6-40d9-91bc-d55e77a52c7d {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:05:22 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:22 devstack sudo[85631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d 1073741824 Apr 21 02:05:22 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Flow 'volume_create_manager' (e846928d-b829-4a55-a6a3-b8afc7e776c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06214768-7fe4-4b17-8412-450ed1c1610a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06214768-7fe4-4b17-8412-450ed1c1610a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1238727541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71bd5ace-79c6-41e7-a3ac-e5c6c873ee51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c91a9cd965946128f84da6b2f44d141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:23Z,use_quota=True,user_id='bcfa0844e7304ada919a0a308cc7cbbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df91fe3-d5fd-4c4c-86b5-547a04f21598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df91fe3-d5fd-4c4c-86b5-547a04f21598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18cd9697-b8bd-412e-a407-d15665356fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18cd9697-b8bd-412e-a407-d15665356fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71bd5ace-79c6-41e7-a3ac-e5c6c873ee51', 'volume_name': 'volume-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d70c63-f16a-490d-b92a-3e9f6f77ef01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d70c63-f16a-490d-b92a-3e9f6f77ef01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ecea9f3-d64f-430c-be38-bda201698459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:22 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Volume 71bd5ace-79c6-41e7-a3ac-e5c6c873ee51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51', 'volume_size': 1} Apr 21 02:05:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:23 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d 1073741824" returned: 0 in 0.593s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:23 devstack sudo[85636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d Apr 21 02:05:23 devstack sudo[85636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:23 devstack sudo[85636]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d" returned: 0 in 0.512s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.018s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1238727541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71bd5ace-79c6-41e7-a3ac-e5c6c873ee51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c91a9cd965946128f84da6b2f44d141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:23Z,use_quota=True,user_id='bcfa0844e7304ada919a0a308cc7cbbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Creating volume 71bd5ace-79c6-41e7-a3ac-e5c6c873ee51 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:05:23 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108b4011-bded-4de8-97e3-beba9b74f1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48ddeca-58c4-40e9-b845-afee29bb0862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:23 devstack sudo[85640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51 1073741824 Apr 21 02:05:23 devstack sudo[85640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:23 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Volume volume-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d (207ddfb6-e4c6-40d9-91bc-d55e77a52c7d): created successfully Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48ddeca-58c4-40e9-b845-afee29bb0862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:23 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Flow 'volume_create_manager' (fac29a11-8857-4098-818e-78cadc17ecba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:23 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-acea87c2-fb01-48c3-a834-c5f84c73ff30 tempest-VolumesTransfersV357Test-752679062 None] Created volume successfully. Apr 21 02:05:24 devstack sudo[85640]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51 1073741824" returned: 0 in 0.602s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:24 devstack sudo[85645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51 Apr 21 02:05:24 devstack sudo[85645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:24 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] Acquiring lock "cinder-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:24 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] Lock "cinder-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:24 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] Acquiring lock "cinder-quobyte-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] Lock "cinder-quobyte-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:25 devstack sudo[85645]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51" returned: 0 in 0.636s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:05:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:25 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3f8b52-adc3-45d4-b94b-fe81181d54ee]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ecea9f3-d64f-430c-be38-bda201698459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7ae823-8555-4b13-88fa-b1d8b14204a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:25 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Volume volume-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51 (71bd5ace-79c6-41e7-a3ac-e5c6c873ee51): created successfully Apr 21 02:05:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7ae823-8555-4b13-88fa-b1d8b14204a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Flow 'volume_create_manager' (e846928d-b829-4a55-a6a3-b8afc7e776c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:25 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-cf9a5019-5711-446f-b8b9-9c1b0a064826 tempest-VolumesTestJSON-1326838682 None] Created volume successfully. Apr 21 02:05:25 devstack sudo[85649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d Apr 21 02:05:25 devstack sudo[85649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:25 devstack sudo[85649]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d" returned: 0 in 0.694s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:25 devstack sudo[85661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d Apr 21 02:05:25 devstack sudo[85661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:26 devstack sudo[85661]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d" returned: 0 in 0.723s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:26 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] Lock "cinder-quobyte-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d" released by "delete_volume" :: held 1.455s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:26 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] Created reservations ['1489c5c7-d758-41d5-8fb8-6ae703b7f58f', 'f9398b35-a7fa-41fd-acdb-f0438bec8e75', '660ab8e9-835b-41db-b447-765394d71ce4', 'bb5376d9-ea6b-407a-bfa1-a67789569b2c'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:05:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:26 devstack sudo[85690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:05:26 devstack sudo[85690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:26 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] Acquiring lock "cinder-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:26 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] Lock "cinder-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:26 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] Acquiring lock "cinder-quobyte-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:27 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] Lock "cinder-quobyte-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51" acquired by "delete_volume" :: waited 0.016s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:27 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a541e5-920c-4cc6-b36c-991dbec4f1f0]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:27 devstack sudo[85693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51 Apr 21 02:05:27 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:27 devstack sudo[85690]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 1.023s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:27 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:05:27 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] Deleted volume successfully. Apr 21 02:05:27 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ffa97f5d-c0b5-412c-ac77-951278b262d5 tempest-VolumesTransfersV357Test-828505501 None] Lock "cinder-207ddfb6-e4c6-40d9-91bc-d55e77a52c7d-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:27 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51" returned: 0 in 0.701s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:27 devstack sudo[85699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51 Apr 21 02:05:27 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:28 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51" returned: 0 in 0.586s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:28 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] Lock "cinder-quobyte-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51" released by "delete_volume" :: held 1.314s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:28 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] Created reservations ['634fa58c-6f3b-4cca-92b9-dddb4187cc47', '1376e9a0-ba23-4477-b189-d08ec91e064d', 'e20e217a-9ca1-4bdd-89e9-a7ce7667eaab', 'b893025e-d42a-453c-9ef2-4d2b1b983a59'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:05:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:28 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:28 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:28 devstack sudo[85702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:05:28 devstack sudo[85702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:29 devstack sudo[85702]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.742s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:29 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:05:29 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] Deleted volume successfully. Apr 21 02:05:29 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3060bc8d-3c0a-4e96-8ae5-c2d44adb7a85 tempest-VolumesTestJSON-1326838682 None] Lock "cinder-71bd5ace-79c6-41e7-a3ac-e5c6c873ee51-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:29 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] Acquiring lock "cinder-f9671de0-58cc-4b3c-82e5-47719a8bb694-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:29 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] Lock "cinder-f9671de0-58cc-4b3c-82e5-47719a8bb694-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:29 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] Acquiring lock "cinder-quobyte-f9671de0-58cc-4b3c-82e5-47719a8bb694" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:29 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] Lock "cinder-quobyte-f9671de0-58cc-4b3c-82e5-47719a8bb694" acquired by "delete_volume" :: waited 0.024s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:29 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a255d4-6914-47ab-b942-ee526559fc9f]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f9671de0-58cc-4b3c-82e5-47719a8bb694 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:29 devstack sudo[85705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f9671de0-58cc-4b3c-82e5-47719a8bb694 Apr 21 02:05:29 devstack sudo[85705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:30 devstack sudo[85705]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f9671de0-58cc-4b3c-82e5-47719a8bb694" returned: 0 in 0.714s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f9671de0-58cc-4b3c-82e5-47719a8bb694 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:30 devstack sudo[85710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f9671de0-58cc-4b3c-82e5-47719a8bb694 Apr 21 02:05:30 devstack sudo[85710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Flow 'volume_create_manager' (ec290dfb-667e-4329-9908-18965e308297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a4a69f-65b8-498f-b600-891ce3b42e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a4a69f-65b8-498f-b600-891ce3b42e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-203697072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f8546c-fef4-4a26-947f-3e2bca42c261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f387d9783acd482faf9dbaafcf196707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:30Z,use_quota=True,user_id='8c6c72bbbab141989dd742ba0165578e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b59ace-3783-4d0d-8516-2e5ce5aeee44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b59ace-3783-4d0d-8516-2e5ce5aeee44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a82f05-a9f5-45cc-bf3f-3cb5d61aa780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a82f05-a9f5-45cc-bf3f-3cb5d61aa780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45f8546c-fef4-4a26-947f-3e2bca42c261', 'volume_name': 'volume-45f8546c-fef4-4a26-947f-3e2bca42c261', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fdf04c2-e8e2-49b2-ba40-170f135dd72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fdf04c2-e8e2-49b2-ba40-170f135dd72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3ddd81-6345-4de1-badf-b85c33113fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:30 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Volume 45f8546c-fef4-4a26-947f-3e2bca42c261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45f8546c-fef4-4a26-947f-3e2bca42c261', 'volume_size': 1} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-203697072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f8546c-fef4-4a26-947f-3e2bca42c261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f387d9783acd482faf9dbaafcf196707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:30Z,use_quota=True,user_id='8c6c72bbbab141989dd742ba0165578e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Creating volume 45f8546c-fef4-4a26-947f-3e2bca42c261 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:05:30 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-45f8546c-fef4-4a26-947f-3e2bca42c261 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:30 devstack sudo[85712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-45f8546c-fef4-4a26-947f-3e2bca42c261 1073741824 Apr 21 02:05:30 devstack sudo[85712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:30 devstack sudo[85710]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f9671de0-58cc-4b3c-82e5-47719a8bb694" returned: 0 in 0.922s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:30 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] Lock "cinder-quobyte-f9671de0-58cc-4b3c-82e5-47719a8bb694" released by "delete_volume" :: held 1.670s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:31 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] Created reservations ['a96cd6de-08ee-4b0c-a583-64430c992727', 'a28f84f8-57bd-4c33-8df7-44bcf80197b9', 'acceb15d-347c-4b3a-b3b2-85b3a99d78b2', '91230d95-0041-48a9-a5a9-1ec062677f16'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:05:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:31 devstack sudo[85722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:05:31 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:31 devstack sudo[85712]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-45f8546c-fef4-4a26-947f-3e2bca42c261 1073741824" returned: 0 in 0.975s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-45f8546c-fef4-4a26-947f-3e2bca42c261 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:31 devstack sudo[85725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-45f8546c-fef4-4a26-947f-3e2bca42c261 Apr 21 02:05:31 devstack sudo[85725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:31 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] Acquiring lock "cinder-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:31 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] Lock "cinder-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:31 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] Acquiring lock "cinder-quobyte-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:31 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] Lock "cinder-quobyte-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:31 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6286c7f7-7279-434e-b683-e6ec7356ec20]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:31 devstack sudo[85729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d Apr 21 02:05:31 devstack sudo[85729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:31 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.684s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:31 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:05:31 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] Deleted volume successfully. Apr 21 02:05:31 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4b0f9706-1998-40b8-a098-638258244bdf tempest-VolumesTestJSON-1326838682 None] Lock "cinder-f9671de0-58cc-4b3c-82e5-47719a8bb694-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:32 devstack sudo[85725]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-45f8546c-fef4-4a26-947f-3e2bca42c261" returned: 0 in 0.744s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3ddd81-6345-4de1-badf-b85c33113fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f8546c-fef4-4a26-947f-3e2bca42c261', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfd122b-349c-47e2-8b09-07c59016596d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:32 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Volume volume-45f8546c-fef4-4a26-947f-3e2bca42c261 (45f8546c-fef4-4a26-947f-3e2bca42c261): created successfully Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfd122b-349c-47e2-8b09-07c59016596d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Flow 'volume_create_manager' (ec290dfb-667e-4329-9908-18965e308297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:32 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-702627fa-5118-411c-a3b1-99220e97b7d5 tempest-VolumesListAdminTestJSON-1520825732 None] Created volume successfully. Apr 21 02:05:32 devstack sudo[85729]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d" returned: 0 in 0.699s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:32 devstack sudo[85736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d Apr 21 02:05:32 devstack sudo[85736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:32 devstack sudo[85736]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d" returned: 0 in 0.527s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] Lock "cinder-quobyte-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d" released by "delete_volume" :: held 1.265s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Flow 'volume_create_manager' (31bd97fc-f731-4920-9aae-5ecfdac77e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776b8075-1812-479e-8540-b8938ae2fddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776b8075-1812-479e-8540-b8938ae2fddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-438094446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c1e65b7-f0bb-44bf-987e-11750a717403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f387d9783acd482faf9dbaafcf196707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:33Z,use_quota=True,user_id='8c6c72bbbab141989dd742ba0165578e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a08f1b-82e8-40f4-bcef-2a1872feda40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a08f1b-82e8-40f4-bcef-2a1872feda40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e34b351a-28fa-41c4-af82-23a282442e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e34b351a-28fa-41c4-af82-23a282442e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c1e65b7-f0bb-44bf-987e-11750a717403', 'volume_name': 'volume-6c1e65b7-f0bb-44bf-987e-11750a717403', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e7a419-e19b-4e23-9001-ea4a4ec2c632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e7a419-e19b-4e23-9001-ea4a4ec2c632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce02dae-e430-4a17-94fc-1de6f7e1882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:32 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Volume 6c1e65b7-f0bb-44bf-987e-11750a717403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c1e65b7-f0bb-44bf-987e-11750a717403', 'volume_size': 1} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-438094446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c1e65b7-f0bb-44bf-987e-11750a717403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f387d9783acd482faf9dbaafcf196707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:33Z,use_quota=True,user_id='8c6c72bbbab141989dd742ba0165578e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Creating volume 6c1e65b7-f0bb-44bf-987e-11750a717403 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:05:32 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:05:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6c1e65b7-f0bb-44bf-987e-11750a717403 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:32 devstack sudo[85739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6c1e65b7-f0bb-44bf-987e-11750a717403 1073741824 Apr 21 02:05:32 devstack sudo[85739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:33 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] Created reservations ['8164d4de-b0ab-4b5d-b40b-2131e9f4feda', '77d83c11-21ea-4133-9a48-2e9dd00dd70e', 'a8168d5a-6496-4237-b526-56a9a43a8fe4', '3f1c1d3b-9b1f-44d7-b1a8-8f6c1891f50e'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:05:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:33 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:33 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:33 devstack sudo[85741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:05:33 devstack sudo[85741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:33 devstack sudo[85739]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6c1e65b7-f0bb-44bf-987e-11750a717403 1073741824" returned: 0 in 0.630s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:33 devstack sudo[85741]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.536s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:33 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:05:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6c1e65b7-f0bb-44bf-987e-11750a717403 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:33 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] Deleted volume successfully. Apr 21 02:05:33 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-10c2866d-02a4-431f-b6eb-ade4017e5273 tempest-VolumesTestJSON-1326838682 None] Lock "cinder-a9fc3b8a-9a52-4e70-82d0-e6fcb503478d-delete_volume" released by "delete_volume" :: held 2.132s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:33 devstack sudo[85747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6c1e65b7-f0bb-44bf-987e-11750a717403 Apr 21 02:05:33 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:34 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6c1e65b7-f0bb-44bf-987e-11750a717403" returned: 0 in 0.631s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:34 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:05:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:34 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce02dae-e430-4a17-94fc-1de6f7e1882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c1e65b7-f0bb-44bf-987e-11750a717403', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:34 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a683aeed-5bae-4ba7-947e-1c345dbbffeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:34 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Volume volume-6c1e65b7-f0bb-44bf-987e-11750a717403 (6c1e65b7-f0bb-44bf-987e-11750a717403): created successfully Apr 21 02:05:34 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a683aeed-5bae-4ba7-947e-1c345dbbffeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:34 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Flow 'volume_create_manager' (31bd97fc-f731-4920-9aae-5ecfdac77e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:34 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b49fc5b8-b28f-44ef-9465-a7a5c2985e6f tempest-VolumesListAdminTestJSON-1520825732 None] Created volume successfully. Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Flow 'volume_create_manager' (cd566a3c-5921-429f-b63a-66a72872ccad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d3bb2d-3a7e-4650-babb-a2385ad4ed14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d3bb2d-3a7e-4650-babb-a2385ad4ed14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-38597061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf766cf-7d5b-4928-81c2-769be8ead205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f387d9783acd482faf9dbaafcf196707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:35Z,use_quota=True,user_id='8c6c72bbbab141989dd742ba0165578e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1f46602-6aa5-490c-bd92-b305e173cf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1f46602-6aa5-490c-bd92-b305e173cf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b70aeb-424c-421c-b136-bf11a1c73630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b70aeb-424c-421c-b136-bf11a1c73630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccf766cf-7d5b-4928-81c2-769be8ead205', 'volume_name': 'volume-ccf766cf-7d5b-4928-81c2-769be8ead205', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927ef50a-2090-4cef-a261-899502d4af5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927ef50a-2090-4cef-a261-899502d4af5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07dd2abc-912e-4c6b-b999-af3e675112f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:35 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Volume ccf766cf-7d5b-4928-81c2-769be8ead205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccf766cf-7d5b-4928-81c2-769be8ead205', 'volume_size': 1} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-38597061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf766cf-7d5b-4928-81c2-769be8ead205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f387d9783acd482faf9dbaafcf196707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:35Z,use_quota=True,user_id='8c6c72bbbab141989dd742ba0165578e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Creating volume ccf766cf-7d5b-4928-81c2-769be8ead205 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:05:35 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:05:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ccf766cf-7d5b-4928-81c2-769be8ead205 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:35 devstack sudo[85752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ccf766cf-7d5b-4928-81c2-769be8ead205 1073741824 Apr 21 02:05:35 devstack sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:36 devstack sudo[85752]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ccf766cf-7d5b-4928-81c2-769be8ead205 1073741824" returned: 0 in 0.956s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ccf766cf-7d5b-4928-81c2-769be8ead205 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:36 devstack sudo[85757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ccf766cf-7d5b-4928-81c2-769be8ead205 Apr 21 02:05:36 devstack sudo[85757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:37 devstack sudo[85757]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ccf766cf-7d5b-4928-81c2-769be8ead205" returned: 0 in 1.021s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:05:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07dd2abc-912e-4c6b-b999-af3e675112f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccf766cf-7d5b-4928-81c2-769be8ead205', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a2be5f6-5300-4bdc-9a8d-357970d7dfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:37 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Volume volume-ccf766cf-7d5b-4928-81c2-769be8ead205 (ccf766cf-7d5b-4928-81c2-769be8ead205): created successfully Apr 21 02:05:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a2be5f6-5300-4bdc-9a8d-357970d7dfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Flow 'volume_create_manager' (cd566a3c-5921-429f-b63a-66a72872ccad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:37 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-0cac5699-9b1e-4e18-98be-118b906ea952 tempest-VolumesListAdminTestJSON-1520825732 None] Created volume successfully. Apr 21 02:05:37 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:05:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Flow 'volume_create_manager' (ffd7d977-822a-4ebb-bae9-a23f2f3458f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf67a50e-c5f3-44e6-a85a-aa2eba22ab3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf67a50e-c5f3-44e6-a85a-aa2eba22ab3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:37Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e290343d-56d7-4040-9af1-d989e41d4ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585a2c0a56814d74b11b493cf99d9196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:38Z,use_quota=True,user_id='872833c13fca42f09e44b840cdbcf209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96edb719-12a4-4923-a834-c3e30968c061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96edb719-12a4-4923-a834-c3e30968c061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb8f17a-6c6c-43b8-b51f-a8b7dccd952e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:37 devstack cinder-volume[82184]: DEBUG cinder.image.glance [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Creating Keystone auth plugin from conf {{(pid=82184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 02:05:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb8f17a-6c6c-43b8-b51f-a8b7dccd952e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e290343d-56d7-4040-9af1-d989e41d4ea1', 'volume_name': 'volume-e290343d-56d7-4040-9af1-d989e41d4ea1', 'volume_size': 1, 'image_id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b9740a9418bf48ba9dad196958886690', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'created_at': datetime.datetime(2026, 4, 20, 23, 58, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 23, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b22600ee-9d9f-4ee7-8886-ce18034d260d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a24a323-0be4-4fe3-96b6-bdc1fddb29f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a24a323-0be4-4fe3-96b6-bdc1fddb29f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1415c521-6b22-4664-b4db-ea991650c750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:38 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Volume e290343d-56d7-4040-9af1-d989e41d4ea1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e290343d-56d7-4040-9af1-d989e41d4ea1', 'volume_size': 1, 'image_id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b9740a9418bf48ba9dad196958886690', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'created_at': datetime.datetime(2026, 4, 20, 23, 58, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 23, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b22600ee-9d9f-4ee7-8886-ce18034d260d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 02:05:38 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Trying to clone e290343d-56d7-4040-9af1-d989e41d4ea1 from image b22600ee-9d9f-4ee7-8886-ce18034d260d at location (None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}]). {{(pid=82184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 02:05:38 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_gbkh8vctdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82184) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 02:05:38 devstack cinder-volume[82184]: INFO cinder.image.image_utils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Image download 20.69 MB at 20.69 MB/s Apr 21 02:05:38 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b5f1ba-9210-409e-9dcc-672bc5a503a3]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_gbkh8vctdevstack@QuobyteHD {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:38 devstack sudo[85764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_gbkh8vctdevstack@QuobyteHD Apr 21 02:05:38 devstack sudo[85764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:38 devstack cinder-volume[82184]: DEBUG oslo_service.periodic_task [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 02:05:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:38 devstack sudo[85766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:05:38 devstack sudo[85766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:39 devstack sudo[85766]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.855s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:05:39 devstack sudo[85764]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_gbkh8vctdevstack@QuobyteHD" returned: 0 in 1.127s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Temporary image b22600ee-9d9f-4ee7-8886-ce18034d260d is fetched for user 872833c13fca42f09e44b840cdbcf209. {{(pid=82184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Flow 'volume_create_manager' (c7fcc86e-7725-44fc-88f3-141dff616a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575e738f-d24a-40eb-9fd0-8bea51c1b71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575e738f-d24a-40eb-9fd0-8bea51c1b71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b3978f-b538-4842-ab22-c606aa081af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62fffa62432d45bc9f0cf1efd57990de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:40Z,use_quota=True,user_id='2d9e3732b23c475c8b797ee4454e6428',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db837e1e-c933-4755-bd7a-fd43dc95cb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db837e1e-c933-4755-bd7a-fd43dc95cb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1f06ef-8abe-4087-8a42-148838c2c4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1f06ef-8abe-4087-8a42-148838c2c4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b3978f-b538-4842-ab22-c606aa081af0', 'volume_name': 'volume-03b3978f-b538-4842-ab22-c606aa081af0', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337ffdcb-eda5-45bf-92e3-06f9e7df3d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337ffdcb-eda5-45bf-92e3-06f9e7df3d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2a0f98-8103-4e1b-afbe-147f8d087610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:39 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Volume 03b3978f-b538-4842-ab22-c606aa081af0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b3978f-b538-4842-ab22-c606aa081af0', 'volume_size': 1} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b3978f-b538-4842-ab22-c606aa081af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62fffa62432d45bc9f0cf1efd57990de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:40Z,use_quota=True,user_id='2d9e3732b23c475c8b797ee4454e6428',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Creating volume 03b3978f-b538-4842-ab22-c606aa081af0 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:05:39 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03b3978f-b538-4842-ab22-c606aa081af0 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:39 devstack sudo[85772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03b3978f-b538-4842-ab22-c606aa081af0 1073741824 Apr 21 02:05:39 devstack sudo[85772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccbe44d-a9d8-4baa-b621-bfaab8127f69]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_gbkh8vctdevstack@QuobyteHD {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:39 devstack sudo[85775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_gbkh8vctdevstack@QuobyteHD Apr 21 02:05:39 devstack sudo[85775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:40 devstack sudo[85775]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_gbkh8vctdevstack@QuobyteHD" returned: 0 in 0.647s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:40 devstack sudo[85772]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03b3978f-b538-4842-ab22-c606aa081af0 1073741824" returned: 0 in 1.105s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03b3978f-b538-4842-ab22-c606aa081af0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:40 devstack sudo[85790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03b3978f-b538-4842-ab22-c606aa081af0 Apr 21 02:05:40 devstack sudo[85790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Flow 'volume_create_manager' (4391a616-e6f0-4f5d-94fe-bc7c28283059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0cb2336-5c85-48dc-9246-7dbdd5a28689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0cb2336-5c85-48dc-9246-7dbdd5a28689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-815371682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=273da430-61af-4702-ba70-1dfed29fcc52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5de75143584e1890dd7815106e0d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:42Z,use_quota=True,user_id='63281a00da53451f8a6a89d094e90619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dc3242d-49a6-4951-bc63-288daf851c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dc3242d-49a6-4951-bc63-288daf851c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c050c0-4e6f-4d74-bf67-4ebbb8633955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:41 devstack sudo[85790]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c050c0-4e6f-4d74-bf67-4ebbb8633955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '273da430-61af-4702-ba70-1dfed29fcc52', 'volume_name': 'volume-273da430-61af-4702-ba70-1dfed29fcc52', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e34fe6d-46ff-48be-8c26-682ff5ecbe62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e34fe6d-46ff-48be-8c26-682ff5ecbe62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a607ed20-b630-4dc1-a9fc-b5c7eaa5e144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:41 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Volume 273da430-61af-4702-ba70-1dfed29fcc52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-273da430-61af-4702-ba70-1dfed29fcc52', 'volume_size': 1} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03b3978f-b538-4842-ab22-c606aa081af0" returned: 0 in 0.700s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.135s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:37Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e290343d-56d7-4040-9af1-d989e41d4ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585a2c0a56814d74b11b493cf99d9196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:38Z,use_quota=True,user_id='872833c13fca42f09e44b840cdbcf209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Creating volume e290343d-56d7-4040-9af1-d989e41d4ea1 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:05:41 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2a0f98-8103-4e1b-afbe-147f8d087610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b3978f-b538-4842-ab22-c606aa081af0', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:41 devstack sudo[85793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 1073741824 Apr 21 02:05:41 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f979f3-1b6f-4bc2-937c-bed98ee71edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:41 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Volume volume-03b3978f-b538-4842-ab22-c606aa081af0 (03b3978f-b538-4842-ab22-c606aa081af0): created successfully Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f979f3-1b6f-4bc2-937c-bed98ee71edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Flow 'volume_create_manager' (c7fcc86e-7725-44fc-88f3-141dff616a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:41 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-7e091c0b-7cea-4491-9a73-7bab593acfe1 tempest-VolumesListAdminTestJSON-84109132 None] Created volume successfully. Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Flow 'volume_create_manager' (b2158ac1-9fb3-4f31-a49a-120feb136150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a572bd9-361d-4627-8c4b-99d4f29e4d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a572bd9-361d-4627-8c4b-99d4f29e4d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1962192299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc15c19-6e3f-4cbb-aa38-b50bf851232b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ffe764129e49f08547a22ab3b14e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:42Z,use_quota=True,user_id='e47c2d5df4d24e61bebed1ffbaf821d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb3895e-f9fc-4282-90d5-44bab7e9b488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb3895e-f9fc-4282-90d5-44bab7e9b488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02471009-7af0-4753-9de4-9e83d3d1dd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02471009-7af0-4753-9de4-9e83d3d1dd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cc15c19-6e3f-4cbb-aa38-b50bf851232b', 'volume_name': 'volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24409a3f-f11e-402f-beef-380b670e06b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24409a3f-f11e-402f-beef-380b670e06b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce62fba-1542-492d-9b97-40259ce6b25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:42 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Volume 1cc15c19-6e3f-4cbb-aa38-b50bf851232b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b', 'volume_size': 1} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:42 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 1073741824" returned: 0 in 0.565s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:42 devstack sudo[85815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 Apr 21 02:05:42 devstack sudo[85815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:42 devstack sudo[85815]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1" returned: 0 in 0.413s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.021s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-815371682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=273da430-61af-4702-ba70-1dfed29fcc52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5de75143584e1890dd7815106e0d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:42Z,use_quota=True,user_id='63281a00da53451f8a6a89d094e90619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Creating volume 273da430-61af-4702-ba70-1dfed29fcc52 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:05:42 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG cinder.volume.volume_utils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Attempting download of b22600ee-9d9f-4ee7-8886-ce18034d260d ((None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}])) to volume e290343d-56d7-4040-9af1-d989e41d4ea1. {{(pid=82184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 02:05:42 devstack sudo[85818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 1073741824 Apr 21 02:05:42 devstack sudo[85818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f3bb64-594c-47b3-ac17-6dbfaf3df254]: (4, 'raw') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_oyok1xjy {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:42 devstack sudo[85820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_oyok1xjy Apr 21 02:05:42 devstack sudo[85820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] Acquiring lock "cinder-03b3978f-b538-4842-ab22-c606aa081af0-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] Lock "cinder-03b3978f-b538-4842-ab22-c606aa081af0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] Acquiring lock "cinder-quobyte-03b3978f-b538-4842-ab22-c606aa081af0" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] Lock "cinder-quobyte-03b3978f-b538-4842-ab22-c606aa081af0" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[99197eb2-2972-4311-be71-44319e7a4e2d]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03b3978f-b538-4842-ab22-c606aa081af0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] Acquiring lock "cinder-ccf766cf-7d5b-4928-81c2-769be8ead205-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:43 devstack sudo[85825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03b3978f-b538-4842-ab22-c606aa081af0 Apr 21 02:05:43 devstack sudo[85825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:43 devstack sudo[85818]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "cinder-ccf766cf-7d5b-4928-81c2-769be8ead205-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 1073741824" returned: 0 in 0.610s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] Acquiring lock "cinder-quobyte-ccf766cf-7d5b-4928-81c2-769be8ead205" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "cinder-quobyte-ccf766cf-7d5b-4928-81c2-769be8ead205" acquired by "delete_volume" :: waited 0.015s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5de05c1-e649-48d3-a94f-7ed42ecd8b12]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ccf766cf-7d5b-4928-81c2-769be8ead205 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:43 devstack sudo[85829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 Apr 21 02:05:43 devstack sudo[85829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:43 devstack sudo[85820]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_oyok1xjy" returned: 0 in 0.708s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_oyok1xjy {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:43 devstack sudo[85830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ccf766cf-7d5b-4928-81c2-769be8ead205 Apr 21 02:05:43 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:43 devstack sudo[85832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_oyok1xjy Apr 21 02:05:43 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:43 devstack sudo[85825]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03b3978f-b538-4842-ab22-c606aa081af0" returned: 0 in 0.645s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03b3978f-b538-4842-ab22-c606aa081af0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:43 devstack sudo[85839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03b3978f-b538-4842-ab22-c606aa081af0 Apr 21 02:05:43 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:43 devstack sudo[85829]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52" returned: 0 in 0.558s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.734s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1962192299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc15c19-6e3f-4cbb-aa38-b50bf851232b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ffe764129e49f08547a22ab3b14e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:42Z,use_quota=True,user_id='e47c2d5df4d24e61bebed1ffbaf821d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Creating volume 1cc15c19-6e3f-4cbb-aa38-b50bf851232b {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:05:43 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a607ed20-b630-4dc1-a9fc-b5c7eaa5e144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-273da430-61af-4702-ba70-1dfed29fcc52', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ddd4e35-ca12-49fb-90f5-09a1e50383b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:44 devstack sudo[85844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b 1073741824 Apr 21 02:05:44 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:44 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Volume volume-273da430-61af-4702-ba70-1dfed29fcc52 (273da430-61af-4702-ba70-1dfed29fcc52): created successfully Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ddd4e35-ca12-49fb-90f5-09a1e50383b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Flow 'volume_create_manager' (4391a616-e6f0-4f5d-94fe-bc7c28283059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:44 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b49aca22-4cff-442f-8f4f-12adc932e820 tempest-VolumesActionsTest-1192287018 None] Created volume successfully. Apr 21 02:05:44 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ccf766cf-7d5b-4928-81c2-769be8ead205" returned: 0 in 0.693s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ccf766cf-7d5b-4928-81c2-769be8ead205 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:44 devstack sudo[85846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ccf766cf-7d5b-4928-81c2-769be8ead205 Apr 21 02:05:44 devstack sudo[85846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:44 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_oyok1xjy" returned: 1 in 0.900s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_oyok1xjy' failed. Not Retrying. {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dc332b-105c-4955-8572-847137107621]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_gbkh8vctdevstack@QuobyteHD {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:44 devstack sudo[85851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_gbkh8vctdevstack@QuobyteHD Apr 21 02:05:44 devstack sudo[85851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:44 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03b3978f-b538-4842-ab22-c606aa081af0" returned: 0 in 0.752s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] Lock "cinder-quobyte-03b3978f-b538-4842-ab22-c606aa081af0" released by "delete_volume" :: held 1.439s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] Created reservations ['0c1b2569-f17f-423d-a76c-625dc8924bd7', '7f4cc9fb-e26e-48e8-9435-7c8459d47985', '15aa67da-c48e-44a7-a0bf-f956a1290b81', 'd61a5cf7-aafc-4245-bb86-8a11528bb61c'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:44 devstack sudo[85857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:05:44 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:44 devstack sudo[85846]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ccf766cf-7d5b-4928-81c2-769be8ead205" returned: 0 in 0.731s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "cinder-quobyte-ccf766cf-7d5b-4928-81c2-769be8ead205" released by "delete_volume" :: held 1.447s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:44 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b 1073741824" returned: 0 in 0.885s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] Created reservations ['75a87e13-c541-4ad6-9d3a-5f7d6487dc4e', 'f7c1b807-1c96-4e11-8470-259b9e277ab0', 'a4d75fe9-447a-427b-9c63-2aab1bd07067', '8b77ddc2-62fb-4ef5-8954-3b123a8fec4b'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:05:44 devstack sudo[85862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b Apr 21 02:05:44 devstack sudo[85862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:44 devstack sudo[85851]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_gbkh8vctdevstack@QuobyteHD" returned: 0 in 0.638s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] b22600ee-9d9f-4ee7-8886-ce18034d260d was qcow2, converting to raw {{(pid=82184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 02:05:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_gbkh8vctdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:45 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:45 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:45 devstack sudo[85865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_gbkh8vctdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 Apr 21 02:05:45 devstack sudo[85865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:45 devstack sudo[85866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:05:45 devstack sudo[85866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] Acquiring lock "cinder-6c1e65b7-f0bb-44bf-987e-11750a717403-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "cinder-6c1e65b7-f0bb-44bf-987e-11750a717403-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] Acquiring lock "cinder-quobyte-6c1e65b7-f0bb-44bf-987e-11750a717403" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:45 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "cinder-quobyte-6c1e65b7-f0bb-44bf-987e-11750a717403" acquired by "delete_volume" :: waited 0.022s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:45 devstack sudo[85866]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 1.054s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:45 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:05:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.720s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:45 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:05:45 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] Deleted volume successfully. Apr 21 02:05:45 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad8a449-239e-40f2-9c31-750f7f73b61a]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6c1e65b7-f0bb-44bf-987e-11750a717403 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7bcbdbbb-bfc0-45de-b112-8081218b3c87 tempest-VolumesListAdminTestJSON-84109132 None] Lock "cinder-03b3978f-b538-4842-ab22-c606aa081af0-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:45 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] Deleted volume successfully. Apr 21 02:05:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-016fda39-e81b-4218-8734-f7b8cdb1f495 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "cinder-ccf766cf-7d5b-4928-81c2-769be8ead205-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:46 devstack sudo[85875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6c1e65b7-f0bb-44bf-987e-11750a717403 Apr 21 02:05:46 devstack sudo[85875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:46 devstack sudo[85862]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b" returned: 0 in 1.233s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] <== create_volume: return (2195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:05:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.206s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce62fba-1542-492d-9b97-40259ce6b25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846745a7-6380-43c4-a9cd-6a723cc5f72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:46 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Volume volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b (1cc15c19-6e3f-4cbb-aa38-b50bf851232b): created successfully Apr 21 02:05:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846745a7-6380-43c4-a9cd-6a723cc5f72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Flow 'volume_create_manager' (b2158ac1-9fb3-4f31-a49a-120feb136150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:46 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-a54ddd7d-7313-4fdf-a56e-fa1f923b50fc tempest-VolumesDeleteCascade-1259797710 None] Created volume successfully. Apr 21 02:05:46 devstack sudo[85865]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_gbkh8vctdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1" returned: 0 in 1.574s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:46 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_gbkh8vctdevstack@QuobyteHD, size 112.00 MB, duration 1.58 sec, destination /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:05:46 devstack cinder-volume[82184]: INFO cinder.image.image_utils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Converted 112.00 MB image at 71.10 MB/s Apr 21 02:05:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:46 devstack sudo[85893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 1G Apr 21 02:05:46 devstack sudo[85893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] Creating offline snapshot 658ac57f-5b75-43ae-87e0-88b04bfb4af3 of volume 1cc15c19-6e3f-4cbb-aa38-b50bf851232b {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:05:46 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aaee20c-4496-4bcc-ae08-ed156f8be5b0]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:46 devstack sudo[85897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b Apr 21 02:05:46 devstack sudo[85897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:46 devstack sudo[85875]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6c1e65b7-f0bb-44bf-987e-11750a717403" returned: 0 in 0.939s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6c1e65b7-f0bb-44bf-987e-11750a717403 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:46 devstack sudo[85900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6c1e65b7-f0bb-44bf-987e-11750a717403 Apr 21 02:05:46 devstack sudo[85900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:47 devstack sudo[85893]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 1G" returned: 0 in 0.499s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d577fda9-d1a1-4cb9-add3-0b0b8e6bee62]: (4, 'raw') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:47 devstack sudo[85905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 Apr 21 02:05:47 devstack sudo[85905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:47 devstack sudo[85900]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6c1e65b7-f0bb-44bf-987e-11750a717403" returned: 0 in 0.684s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:47 devstack sudo[85897]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b" returned: 0 in 0.786s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "cinder-quobyte-6c1e65b7-f0bb-44bf-987e-11750a717403" released by "delete_volume" :: held 1.685s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:47 devstack sudo[85911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 1G Apr 21 02:05:47 devstack sudo[85911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] Created reservations ['1dafb4f0-1308-4b15-8a2d-13ac7f646eb6', 'f6b8f23f-73be-4bfb-8c8e-7da9dc79926b', '32a4e2ba-f220-4467-a75b-60d5dea40411', 'c6e54d2b-5df9-416d-80f9-860946ab6d34'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:47 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:05:47 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:47 devstack sudo[85905]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1" returned: 0 in 0.590s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:47 devstack sudo[85917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 Apr 21 02:05:47 devstack sudo[85917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] Acquiring lock "cinder-45f8546c-fef4-4a26-947f-3e2bca42c261-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "cinder-45f8546c-fef4-4a26-947f-3e2bca42c261-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] Acquiring lock "cinder-quobyte-45f8546c-fef4-4a26-947f-3e2bca42c261" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "cinder-quobyte-45f8546c-fef4-4a26-947f-3e2bca42c261" acquired by "delete_volume" :: waited 0.024s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71d822b-9882-4254-8c18-cf4fe1e801b8]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-45f8546c-fef4-4a26-947f-3e2bca42c261 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:48 devstack sudo[85911]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 1G" returned: 0 in 0.691s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:48 devstack sudo[85924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 Apr 21 02:05:48 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:48 devstack sudo[85924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.611s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:05:48 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] Deleted volume successfully. Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3991b30-e733-412a-b38c-67c058522bb5 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "cinder-6c1e65b7-f0bb-44bf-987e-11750a717403-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:48 devstack sudo[85923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-45f8546c-fef4-4a26-947f-3e2bca42c261 Apr 21 02:05:48 devstack sudo[85923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:48 devstack sudo[85917]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1" returned: 1 in 0.626s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1' failed. Not Retrying. {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG cinder.volume.volume_utils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Downloaded image b22600ee-9d9f-4ee7-8886-ce18034d260d ((None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}])) to volume e290343d-56d7-4040-9af1-d989e41d4ea1 successfully. {{(pid=82184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Temporary image b22600ee-9d9f-4ee7-8886-ce18034d260d for user 872833c13fca42f09e44b840cdbcf209 is deleted. {{(pid=82184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG cinder.volume.volume_utils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Marking volume e290343d-56d7-4040-9af1-d989e41d4ea1 as bootable. {{(pid=82184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Copying metadata from image b22600ee-9d9f-4ee7-8886-ce18034d260d to e290343d-56d7-4040-9af1-d989e41d4ea1. {{(pid=82184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Creating volume glance metadata for volume e290343d-56d7-4040-9af1-d989e41d4ea1 backed by image b22600ee-9d9f-4ee7-8886-ce18034d260d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1415c521-6b22-4664-b4db-ea991650c750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e290343d-56d7-4040-9af1-d989e41d4ea1', 'volume_size': 1, 'image_id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b9740a9418bf48ba9dad196958886690', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'created_at': datetime.datetime(2026, 4, 20, 23, 58, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 23, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b22600ee-9d9f-4ee7-8886-ce18034d260d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c901df96-1436-4df6-9aa0-ee59e6c5342b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:48 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Volume volume-e290343d-56d7-4040-9af1-d989e41d4ea1 (e290343d-56d7-4040-9af1-d989e41d4ea1): created successfully Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c901df96-1436-4df6-9aa0-ee59e6c5342b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Flow 'volume_create_manager' (ffd7d977-822a-4ebb-bae9-a23f2f3458f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:48 devstack cinder-volume[82184]: INFO cinder.volume.manager [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-ff8d9721-11d0-46c9-9e8f-59756d66a442 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Created volume successfully. Apr 21 02:05:48 devstack sudo[85924]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3" returned: 0 in 0.499s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:48 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 is being set with open permissions: ugo+rw Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:48 devstack sudo[85936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 Apr 21 02:05:48 devstack sudo[85936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:48 devstack sudo[85923]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-45f8546c-fef4-4a26-947f-3e2bca42c261" returned: 0 in 0.716s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-45f8546c-fef4-4a26-947f-3e2bca42c261 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:48 devstack sudo[85944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-45f8546c-fef4-4a26-947f-3e2bca42c261 Apr 21 02:05:48 devstack sudo[85944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:49 devstack sudo[85936]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3" returned: 0 in 0.472s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:49 devstack sudo[85948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.info Apr 21 02:05:49 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:49 devstack sudo[85944]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-45f8546c-fef4-4a26-947f-3e2bca42c261" returned: 0 in 0.426s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:49 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "cinder-quobyte-45f8546c-fef4-4a26-947f-3e2bca42c261" released by "delete_volume" :: held 1.177s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:49 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] Created reservations ['22c7f705-b198-48bf-9769-6a11c2405b91', '75694e16-46ca-4d16-9c06-07dbe9e2a899', '4b249f46-2d7c-490c-8457-d54f342242c2', '3dc19d8c-2181-432d-953b-cc31036525b7'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:05:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:49 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:49 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:49 devstack sudo[85950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:05:49 devstack sudo[85950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:49 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.info" returned: 0 in 0.464s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:49 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.info is being set with open permissions: ugo+rw Apr 21 02:05:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:49 devstack sudo[85953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.info Apr 21 02:05:49 devstack sudo[85953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:49 devstack sudo[85950]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.427s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:49 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:05:49 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] Deleted volume successfully. Apr 21 02:05:49 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-01446d9e-56c0-4c23-ab71-2ffa5043c197 tempest-VolumesListAdminTestJSON-1520825732 None] Lock "cinder-45f8546c-fef4-4a26-947f-3e2bca42c261-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:05:50 devstack sudo[85953]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.info" returned: 0 in 0.453s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.442s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:50 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-75c9be31-5ec9-4e33-8111-618bd82a91ff tempest-VolumesDeleteCascade-1259797710 None] Create snapshot completed successfully Apr 21 02:05:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-1e7bd18f-8e77-4d96-8641-e76f4fd6b783 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-1e7bd18f-8e77-4d96-8641-e76f4fd6b783 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:50 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab11d657-1322-4636-9a8a-9094729388d1]: (4, 'raw') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-1e7bd18f-8e77-4d96-8641-e76f4fd6b783 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:50 devstack sudo[85999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 Apr 21 02:05:50 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-144f1ab2-8af3-4065-a0f7-1c2c10087fa0 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:51 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-1e7bd18f-8e77-4d96-8641-e76f4fd6b783 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1" returned: 0 in 0.701s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-1e7bd18f-8e77-4d96-8641-e76f4fd6b783 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:51 devstack sudo[86003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 Apr 21 02:05:51 devstack sudo[86003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:51 devstack sudo[86003]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-1e7bd18f-8e77-4d96-8641-e76f4fd6b783 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1" returned: 1 in 0.553s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-1e7bd18f-8e77-4d96-8641-e76f4fd6b783 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1' failed. Not Retrying. {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 02:05:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-1e7bd18f-8e77-4d96-8641-e76f4fd6b783 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.295s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-144f1ab2-8af3-4065-a0f7-1c2c10087fa0 tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.964s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:51 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-144f1ab2-8af3-4065-a0f7-1c2c10087fa0 tempest-VolumesDeleteCascade-1259797710 None] Creating offline snapshot fe002664-5ed1-4f62-ba16-84767c885fd2 of volume 1cc15c19-6e3f-4cbb-aa38-b50bf851232b {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:05:51 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[038d1e6e-545b-4044-9f4a-c49ab0be25f4]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-144f1ab2-8af3-4065-a0f7-1c2c10087fa0 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-1e7bd18f-8e77-4d96-8641-e76f4fd6b783 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b', 'name': 'volume-e290343d-56d7-4040-9af1-d989e41d4ea1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f15600d8-d3dd-4fe2-b312-df3f7ba608cb', 'enforce_multipath': True} {{(pid=82184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 21 02:05:51 devstack cinder-volume[82184]: INFO cinder.volume.manager [req-086c11cd-cf93-4772-bcdb-b565ccf0fe59 req-1e7bd18f-8e77-4d96-8641-e76f4fd6b783 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] attachment_update completed successfully. Apr 21 02:05:51 devstack sudo[86008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 Apr 21 02:05:51 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:52 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-144f1ab2-8af3-4065-a0f7-1c2c10087fa0 tempest-VolumesDeleteCascade-1259797710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3" returned: 0 in 0.653s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:52 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-144f1ab2-8af3-4065-a0f7-1c2c10087fa0 tempest-VolumesDeleteCascade-1259797710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:05:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-144f1ab2-8af3-4065-a0f7-1c2c10087fa0 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:52 devstack sudo[86021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 1G Apr 21 02:05:52 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:53 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-144f1ab2-8af3-4065-a0f7-1c2c10087fa0 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 1G" returned: 0 in 0.591s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-144f1ab2-8af3-4065-a0f7-1c2c10087fa0 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:53 devstack sudo[86035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 Apr 21 02:05:53 devstack sudo[86035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:53 devstack sudo[86035]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-144f1ab2-8af3-4065-a0f7-1c2c10087fa0 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2" returned: 0 in 0.482s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:53 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-144f1ab2-8af3-4065-a0f7-1c2c10087fa0 tempest-VolumesDeleteCascade-1259797710 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 is being set with open permissions: ugo+rw Apr 21 02:05:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-144f1ab2-8af3-4065-a0f7-1c2c10087fa0 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:53 devstack sudo[86041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 Apr 21 02:05:53 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:54 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-144f1ab2-8af3-4065-a0f7-1c2c10087fa0 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2" returned: 0 in 0.475s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-144f1ab2-8af3-4065-a0f7-1c2c10087fa0 tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.279s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:54 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-144f1ab2-8af3-4065-a0f7-1c2c10087fa0 tempest-VolumesDeleteCascade-1259797710 None] Create snapshot completed successfully Apr 21 02:05:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "cinder-1cc15c19-6e3f-4cbb-aa38-b50bf851232b-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-1cc15c19-6e3f-4cbb-aa38-b50bf851232b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Performing cascade delete. {{(pid=82184) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 21 02:05:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "cinder-658ac57f-5b75-43ae-87e0-88b04bfb4af3-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-658ac57f-5b75-43ae-87e0-88b04bfb4af3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "cinder-quobyte-1cc15c19-6e3f-4cbb-aa38-b50bf851232b" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-1cc15c19-6e3f-4cbb-aa38-b50bf851232b" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "cinder-quobyte-658ac57f-5b75-43ae-87e0-88b04bfb4af3" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:05:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-658ac57f-5b75-43ae-87e0-88b04bfb4af3" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:05:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Deleting offline snapshot 658ac57f-5b75-43ae-87e0-88b04bfb4af3 of volume 1cc15c19-6e3f-4cbb-aa38-b50bf851232b {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:05:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] snapshot_file for this snap is: volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:05:55 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff3b04c-f3e4-4917-a520-5d255e3f523b]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:55 devstack sudo[86054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 Apr 21 02:05:55 devstack sudo[86054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:55 devstack sudo[86054]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3" returned: 0 in 0.574s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:05:55 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[66253ceb-a8fc-4843-8e3d-0551939ba014]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:55 devstack sudo[86059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b Apr 21 02:05:55 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:56 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b" returned: 0 in 0.533s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:56 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e182e69-4776-4c9d-8e05-902bdb0e9266]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:56 devstack sudo[86086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 Apr 21 02:05:56 devstack sudo[86086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:57 devstack sudo[86086]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2" returned: 0 in 1.170s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c434edf7-d9fa-4e7c-a866-a8a97366f02a]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:57 devstack sudo[86126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 Apr 21 02:05:57 devstack sudo[86126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Flow 'volume_create_manager' (b7a2a627-6773-4691-9902-ee8e05a70023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18276173-2717-4270-80c7-b00e3871f58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18276173-2717-4270-80c7-b00e3871f58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-56767889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a2a0ad-d20e-4592-a87e-29298addc494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed28220d9bef440cbebc5ac27bdbf37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:58Z,use_quota=True,user_id='9e6fc49ef89c4b13b7b618602d3961e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f8286d-2f0b-40ae-adfd-3166952bce4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f8286d-2f0b-40ae-adfd-3166952bce4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80df9736-b833-4ac7-92d4-47390bf46cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80df9736-b833-4ac7-92d4-47390bf46cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a2a0ad-d20e-4592-a87e-29298addc494', 'volume_name': 'volume-d4a2a0ad-d20e-4592-a87e-29298addc494', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4e2082-3f92-4b1a-af22-2ea611e87af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4e2082-3f92-4b1a-af22-2ea611e87af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0de6371-3e3f-4c62-8c88-ac11d319f6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:57 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Volume d4a2a0ad-d20e-4592-a87e-29298addc494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a2a0ad-d20e-4592-a87e-29298addc494', 'volume_size': 1} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-56767889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a2a0ad-d20e-4592-a87e-29298addc494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed28220d9bef440cbebc5ac27bdbf37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:05:58Z,use_quota=True,user_id='9e6fc49ef89c4b13b7b618602d3961e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Creating volume d4a2a0ad-d20e-4592-a87e-29298addc494 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:05:57 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:05:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d4a2a0ad-d20e-4592-a87e-29298addc494 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:57 devstack sudo[86129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d4a2a0ad-d20e-4592-a87e-29298addc494 1073741824 Apr 21 02:05:57 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:58 devstack sudo[86126]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3" returned: 0 in 0.962s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:58 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:05:58 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc51e03-cc72-45b3-93d1-4cac7fb6686e]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:05:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:58 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d4a2a0ad-d20e-4592-a87e-29298addc494 1073741824" returned: 0 in 0.654s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:58 devstack sudo[86138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b Apr 21 02:05:58 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d4a2a0ad-d20e-4592-a87e-29298addc494 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:58 devstack sudo[86140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d4a2a0ad-d20e-4592-a87e-29298addc494 Apr 21 02:05:58 devstack sudo[86140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:05:59 devstack sudo[86140]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d4a2a0ad-d20e-4592-a87e-29298addc494" returned: 0 in 0.691s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:59 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:05:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:05:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0de6371-3e3f-4c62-8c88-ac11d319f6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a2a0ad-d20e-4592-a87e-29298addc494', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64eca205-62c8-41f9-952d-35af7d26b7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:05:59 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Volume volume-d4a2a0ad-d20e-4592-a87e-29298addc494 (d4a2a0ad-d20e-4592-a87e-29298addc494): created successfully Apr 21 02:05:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64eca205-62c8-41f9-952d-35af7d26b7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:05:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Flow 'volume_create_manager' (b7a2a627-6773-4691-9902-ee8e05a70023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:05:59 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root Apr 21 02:05:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b" returned: 0 in 0.875s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:05:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:05:59 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-99d39db3-8243-49b9-a865-6b3cbc867858 tempest-AbsoluteLimitsTests-1101829553 None] Created volume successfully. Apr 21 02:05:59 devstack sudo[86148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 Apr 21 02:05:59 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] Acquiring lock "cinder-d4a2a0ad-d20e-4592-a87e-29298addc494-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] Lock "cinder-d4a2a0ad-d20e-4592-a87e-29298addc494-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] Acquiring lock "cinder-quobyte-d4a2a0ad-d20e-4592-a87e-29298addc494" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] Lock "cinder-quobyte-d4a2a0ad-d20e-4592-a87e-29298addc494" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:00 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3" returned: 0 in 0.934s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:00 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[130a992a-ed35-4096-91c5-6fe7401e3444]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d4a2a0ad-d20e-4592-a87e-29298addc494 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:00 devstack sudo[86154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3 Apr 21 02:06:00 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:00 devstack sudo[86155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d4a2a0ad-d20e-4592-a87e-29298addc494 Apr 21 02:06:00 devstack sudo[86155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:00 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.658ac57f-5b75-43ae-87e0-88b04bfb4af3" returned: 0 in 0.505s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 -F qcow2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:00 devstack sudo[86155]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d4a2a0ad-d20e-4592-a87e-29298addc494" returned: 0 in 0.513s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d4a2a0ad-d20e-4592-a87e-29298addc494 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:00 devstack sudo[86162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 -F qcow2 Apr 21 02:06:00 devstack sudo[86162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:00 devstack sudo[86164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d4a2a0ad-d20e-4592-a87e-29298addc494 Apr 21 02:06:00 devstack sudo[86164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:01 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4a708ac3-0df7-4875-b40d-d975a530c579 tempest-VolumesActionsTest-1192287018 None] Acquiring lock "cinder-273da430-61af-4702-ba70-1dfed29fcc52" by "attach_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:01 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4a708ac3-0df7-4875-b40d-d975a530c579 tempest-VolumesActionsTest-1192287018 None] Lock "cinder-273da430-61af-4702-ba70-1dfed29fcc52" acquired by "attach_volume" :: waited 0.021s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:01 devstack sudo[86164]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d4a2a0ad-d20e-4592-a87e-29298addc494" returned: 0 in 0.699s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:01 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] Lock "cinder-quobyte-d4a2a0ad-d20e-4592-a87e-29298addc494" released by "delete_volume" :: held 1.272s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:01 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-4a708ac3-0df7-4875-b40d-d975a530c579 tempest-VolumesActionsTest-1192287018 None] Attaching volume 273da430-61af-4702-ba70-1dfed29fcc52 to instance d7510cb4-3d29-41ce-ae30-662dba65d0db at mountpoint /dev/vdb on host None. Apr 21 02:06:01 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-4a708ac3-0df7-4875-b40d-d975a530c579 tempest-VolumesActionsTest-1192287018 None] Attach volume completed successfully. Apr 21 02:06:01 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4a708ac3-0df7-4875-b40d-d975a530c579 tempest-VolumesActionsTest-1192287018 None] Lock "cinder-273da430-61af-4702-ba70-1dfed29fcc52" released by "attach_volume" :: held 0.200s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:01 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] Created reservations ['b6fff8ca-bbf1-4b99-83e8-aa8a9011db08', '9ddd1c85-02ad-4a73-8268-2df8de702a8b', '629d81a1-4033-47d3-b14b-10cd673f3095', 'bf01b37e-c32d-4020-90ec-3baacbf6c823'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:06:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:01 devstack sudo[86162]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:01 devstack sudo[86170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:06:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 -F qcow2" returned: 0 in 0.995s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:01 devstack sudo[86170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:01 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-658ac57f-5b75-43ae-87e0-88b04bfb4af3" released by "_delete_snapshot" :: held 6.724s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:01 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-1cc15c19-6e3f-4cbb-aa38-b50bf851232b" released by "delete_snapshot" :: held 6.735s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:01 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Created reservations ['64f81adb-72ee-4216-9495-13b971605d29', '1ad44fea-4902-4cc2-b3f9-a7e2dbbd3f70', 'f3423f60-25db-4b8a-b3a2-a2e99c9b7e66', '1c518968-9bac-4846-afa7-4887774ce259'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:06:01 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Delete snapshot completed successfully. Apr 21 02:06:01 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-658ac57f-5b75-43ae-87e0-88b04bfb4af3-delete_snapshot" released by "delete_snapshot" :: held 6.846s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:01 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "cinder-fe002664-5ed1-4f62-ba16-84767c885fd2-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-fe002664-5ed1-4f62-ba16-84767c885fd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "cinder-quobyte-1cc15c19-6e3f-4cbb-aa38-b50bf851232b" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-1cc15c19-6e3f-4cbb-aa38-b50bf851232b" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "cinder-quobyte-fe002664-5ed1-4f62-ba16-84767c885fd2" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-fe002664-5ed1-4f62-ba16-84767c885fd2" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Deleting offline snapshot fe002664-5ed1-4f62-ba16-84767c885fd2 of volume 1cc15c19-6e3f-4cbb-aa38-b50bf851232b {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] snapshot_file for this snap is: volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e7f7bc-67c1-4342-90c0-0e5db44d9b14]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-87377def-8985-400b-9cf5-08ca9881ae33 tempest-VolumesActionsTest-1192287018 None] Acquiring lock "cinder-273da430-61af-4702-ba70-1dfed29fcc52-detach_volume" by "detach_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-87377def-8985-400b-9cf5-08ca9881ae33 tempest-VolumesActionsTest-1192287018 None] Lock "cinder-273da430-61af-4702-ba70-1dfed29fcc52-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:02 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-87377def-8985-400b-9cf5-08ca9881ae33 tempest-VolumesActionsTest-1192287018 None] Detaching volume 273da430-61af-4702-ba70-1dfed29fcc52 from instance d7510cb4-3d29-41ce-ae30-662dba65d0db. Apr 21 02:06:02 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-87377def-8985-400b-9cf5-08ca9881ae33 tempest-VolumesActionsTest-1192287018 None] Detach volume completed successfully. Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-87377def-8985-400b-9cf5-08ca9881ae33 tempest-VolumesActionsTest-1192287018 None] Lock "cinder-273da430-61af-4702-ba70-1dfed29fcc52-detach_volume" released by "detach_volume" :: held 0.046s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:02 devstack sudo[86172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 Apr 21 02:06:02 devstack sudo[86172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:02 devstack sudo[86170]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.491s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:06:02 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] Deleted volume successfully. Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-72c43f56-b965-4bf6-8703-717b1c9cfb0e tempest-AbsoluteLimitsTests-1101829553 None] Lock "cinder-d4a2a0ad-d20e-4592-a87e-29298addc494-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:02 devstack sudo[86172]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2" returned: 0 in 0.800s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bc1696-2904-441f-904c-e26dcbac2780]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:03 devstack sudo[86178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b Apr 21 02:06:03 devstack sudo[86178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:03 devstack sudo[86178]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b" returned: 0 in 0.687s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:03 devstack sudo[86184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 Apr 21 02:06:03 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:04 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2" returned: 0 in 0.673s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:04 devstack sudo[86246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2 Apr 21 02:06:04 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:04 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b.fe002664-5ed1-4f62-ba16-84767c885fd2" returned: 0 in 0.588s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-fe002664-5ed1-4f62-ba16-84767c885fd2" released by "_delete_snapshot" :: held 2.877s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-1cc15c19-6e3f-4cbb-aa38-b50bf851232b" released by "delete_snapshot" :: held 2.897s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:04 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Created reservations ['b4231403-9430-44bc-b760-b735e4c21416', 'e3997dcb-9201-4069-a508-514eb22ea9ba', 'a04baa3e-9d43-45da-a99f-b6ed36f637c4', '5dbb2cec-d3f3-4a2d-8999-759ead20568e'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:06:05 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Delete snapshot completed successfully. Apr 21 02:06:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-fe002664-5ed1-4f62-ba16-84767c885fd2-delete_snapshot" released by "delete_snapshot" :: held 3.007s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:05 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Snapshots deleted, issuing volume delete {{(pid=82184) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 21 02:06:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "cinder-quobyte-1cc15c19-6e3f-4cbb-aa38-b50bf851232b" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-1cc15c19-6e3f-4cbb-aa38-b50bf851232b" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:05 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed795bc-478d-4b06-81f2-741181f526f9]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:05 devstack sudo[86256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b Apr 21 02:06:05 devstack sudo[86256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:05 devstack sudo[86256]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b" returned: 0 in 0.632s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:05 devstack sudo[86267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b Apr 21 02:06:05 devstack sudo[86267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:06 devstack sudo[86267]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1cc15c19-6e3f-4cbb-aa38-b50bf851232b" returned: 0 in 0.609s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:06 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-1cc15c19-6e3f-4cbb-aa38-b50bf851232b" released by "delete_volume" :: held 1.274s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:06 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Created reservations ['00cbf1d2-e990-4dc2-92f2-b54678db8436', '67a77ad4-aa4c-4a07-ae83-14ffca7fb5e4', '71259525-5a07-425d-b248-722abc4b5a2b', '637c6790-ea4a-4a8b-8c46-ac10e2dab22a'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:06:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:06 devstack sudo[86286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:06:06 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:06 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.480s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:06 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:06:06 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Deleted volume successfully. Apr 21 02:06:06 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-59bb16f1-165d-4f2a-b152-62986f90d058 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-1cc15c19-6e3f-4cbb-aa38-b50bf851232b-delete_volume" released by "delete_volume" :: held 11.801s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Flow 'volume_create_manager' (df4ce035-f020-4657-9ce4-e27b3ef924fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e50d35-d7dd-44e4-b00b-9067c9154cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e50d35-d7dd-44e4-b00b-9067c9154cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1930960377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=322904c0-f244-4e20-85c5-77671b7f5f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a8276017d140a9aeb5e6919cd654b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:06:07Z,use_quota=True,user_id='e28ce6f9adc44e079cc00c5c394650b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6651fe3-1967-492a-a57c-864e30834501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6651fe3-1967-492a-a57c-864e30834501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c502d5-7294-4b39-93b0-3c5919cc3c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c502d5-7294-4b39-93b0-3c5919cc3c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '322904c0-f244-4e20-85c5-77671b7f5f2d', 'volume_name': 'volume-322904c0-f244-4e20-85c5-77671b7f5f2d', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb4e3dc-82e4-4552-a6f3-8106b8156ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb4e3dc-82e4-4552-a6f3-8106b8156ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ba92e2-3939-44c5-aaaa-2a4b7f7f0497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:07 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Volume 322904c0-f244-4e20-85c5-77671b7f5f2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-322904c0-f244-4e20-85c5-77671b7f5f2d', 'volume_size': 1} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1930960377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=322904c0-f244-4e20-85c5-77671b7f5f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a8276017d140a9aeb5e6919cd654b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:06:07Z,use_quota=True,user_id='e28ce6f9adc44e079cc00c5c394650b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Creating volume 322904c0-f244-4e20-85c5-77671b7f5f2d {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:06:07 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-322904c0-f244-4e20-85c5-77671b7f5f2d 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:07 devstack sudo[86289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-322904c0-f244-4e20-85c5-77671b7f5f2d 1073741824 Apr 21 02:06:07 devstack sudo[86289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Flow 'volume_create_manager' (9142c796-6dec-42db-8a59-fcd785ef524e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0d2466-3b5e-450a-b9a5-4218e60489fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0d2466-3b5e-450a-b9a5-4218e60489fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-442308409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1fce9b0-6575-429c-be5c-05096b247caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ffe764129e49f08547a22ab3b14e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:06:07Z,use_quota=True,user_id='e47c2d5df4d24e61bebed1ffbaf821d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b458a505-5a1e-44c0-9306-b21747555ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b458a505-5a1e-44c0-9306-b21747555ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e866a19-3c26-45a4-b1c5-bb4a08701f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e866a19-3c26-45a4-b1c5-bb4a08701f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1fce9b0-6575-429c-be5c-05096b247caa', 'volume_name': 'volume-b1fce9b0-6575-429c-be5c-05096b247caa', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b83ffe-ab8b-4bf0-94fb-39f44ece7edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b83ffe-ab8b-4bf0-94fb-39f44ece7edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7866d400-7df3-44d7-9c5d-bf815d71ad39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:07 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Volume b1fce9b0-6575-429c-be5c-05096b247caa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1fce9b0-6575-429c-be5c-05096b247caa', 'volume_size': 1} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:07 devstack sudo[86289]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-322904c0-f244-4e20-85c5-77671b7f5f2d 1073741824" returned: 0 in 0.565s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-322904c0-f244-4e20-85c5-77671b7f5f2d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:07 devstack sudo[86294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-322904c0-f244-4e20-85c5-77671b7f5f2d Apr 21 02:06:07 devstack sudo[86294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:08 devstack sudo[86294]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-322904c0-f244-4e20-85c5-77671b7f5f2d" returned: 0 in 0.465s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.765s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-442308409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1fce9b0-6575-429c-be5c-05096b247caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ffe764129e49f08547a22ab3b14e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:06:07Z,use_quota=True,user_id='e47c2d5df4d24e61bebed1ffbaf821d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Creating volume b1fce9b0-6575-429c-be5c-05096b247caa {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:06:08 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ba92e2-3939-44c5-aaaa-2a4b7f7f0497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-322904c0-f244-4e20-85c5-77671b7f5f2d', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:08 devstack sudo[86297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa 1073741824 Apr 21 02:06:08 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52918201-3ab5-4737-a8e2-8c29c754eccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:08 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Volume volume-322904c0-f244-4e20-85c5-77671b7f5f2d (322904c0-f244-4e20-85c5-77671b7f5f2d): created successfully Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52918201-3ab5-4737-a8e2-8c29c754eccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Flow 'volume_create_manager' (df4ce035-f020-4657-9ce4-e27b3ef924fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:06:08 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-0bbbf2b7-50b5-4b0d-ba7c-29c5ee7a7f2d tempest-VolumesTransfersTest-112986195 None] Created volume successfully. Apr 21 02:06:08 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa 1073741824" returned: 0 in 0.479s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:SELECT=119,cinder:UPDATE=177,cinder:INSERT=43,cinder:DELETE=15 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:SELECT=146,cinder:INSERT=48,cinder:UPDATE=161,cinder:DELETE=15 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:06:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:08 devstack sudo[86303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa Apr 21 02:06:08 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:09 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa" returned: 0 in 0.425s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:06:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7866d400-7df3-44d7-9c5d-bf815d71ad39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1fce9b0-6575-429c-be5c-05096b247caa', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6346350-8099-4af5-b022-f284862c4cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:09 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Volume volume-b1fce9b0-6575-429c-be5c-05096b247caa (b1fce9b0-6575-429c-be5c-05096b247caa): created successfully Apr 21 02:06:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6346350-8099-4af5-b022-f284862c4cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Flow 'volume_create_manager' (9142c796-6dec-42db-8a59-fcd785ef524e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:06:09 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-68150e60-1ac7-4437-aede-63eec6c89963 tempest-VolumesDeleteCascade-1259797710 None] Created volume successfully. Apr 21 02:06:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] Creating offline snapshot 8264e3a0-9708-4a92-8613-e15a9331f59b of volume b1fce9b0-6575-429c-be5c-05096b247caa {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:06:09 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27c785e-43fc-4302-b93d-ef1fbc0216e9]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:09 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-c0fd6169-fd03-452a-a263-e5e0aff04651 tempest-VolumesTransfersTest-779957534 None] Transfer volume completed successfully. Apr 21 02:06:09 devstack sudo[86306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa Apr 21 02:06:09 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:10 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa" returned: 0 in 0.536s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:10 devstack sudo[86315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b 1G Apr 21 02:06:10 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:10 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] Acquiring lock "cinder-322904c0-f244-4e20-85c5-77671b7f5f2d-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:10 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] Lock "cinder-322904c0-f244-4e20-85c5-77671b7f5f2d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:10 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] Acquiring lock "cinder-quobyte-322904c0-f244-4e20-85c5-77671b7f5f2d" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:10 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] Lock "cinder-quobyte-322904c0-f244-4e20-85c5-77671b7f5f2d" acquired by "delete_volume" :: waited 0.014s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:10 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fe65c2-a60b-485f-a60b-253bc97066f6]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-322904c0-f244-4e20-85c5-77671b7f5f2d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:10 devstack sudo[86345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-322904c0-f244-4e20-85c5-77671b7f5f2d Apr 21 02:06:10 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:11 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b 1G" returned: 0 in 0.977s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1fce9b0-6575-429c-be5c-05096b247caa -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:11 devstack sudo[86351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1fce9b0-6575-429c-be5c-05096b247caa -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b Apr 21 02:06:11 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:11 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-322904c0-f244-4e20-85c5-77671b7f5f2d" returned: 0 in 0.599s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-322904c0-f244-4e20-85c5-77671b7f5f2d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:11 devstack sudo[86356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-322904c0-f244-4e20-85c5-77671b7f5f2d Apr 21 02:06:11 devstack sudo[86356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:11 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1fce9b0-6575-429c-be5c-05096b247caa -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b" returned: 0 in 0.488s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:11 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b is being set with open permissions: ugo+rw Apr 21 02:06:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:11 devstack sudo[86361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b Apr 21 02:06:11 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:11 devstack sudo[86356]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-322904c0-f244-4e20-85c5-77671b7f5f2d" returned: 0 in 0.460s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:11 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] Lock "cinder-quobyte-322904c0-f244-4e20-85c5-77671b7f5f2d" released by "delete_volume" :: held 1.103s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:11 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] Created reservations ['a22a200c-6563-4ee4-b769-68ad5917beb3', '3bacda34-6d1f-40ae-a6df-2f4d0ab92a2a', 'd93cd1dd-d45a-4fa3-b0aa-bb7634962e51', '0e75a3e0-fc97-427f-9273-9b0e72e2cbcd'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:06:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:11 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:11 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:11 devstack sudo[86366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:06:11 devstack sudo[86366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:12 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b" returned: 0 in 0.621s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:12 devstack sudo[86370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.info Apr 21 02:06:12 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:12 devstack sudo[86366]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.495s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:12 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:06:12 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] Deleted volume successfully. Apr 21 02:06:12 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b7f7e90c-2a6a-4ab5-a4b8-5a252d160512 tempest-VolumesTransfersTest-161725844 None] Lock "cinder-322904c0-f244-4e20-85c5-77671b7f5f2d-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:12 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.info" returned: 0 in 0.482s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:12 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.info is being set with open permissions: ugo+rw Apr 21 02:06:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:12 devstack sudo[86375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.info Apr 21 02:06:12 devstack sudo[86375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Flow 'volume_create_manager' (0fc99791-8e76-40a2-ab12-c2bd3d0e6988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b26484a-22b4-415e-b425-cc47efd4a359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b26484a-22b4-415e-b425-cc47efd4a359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1003455057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4410767e-1659-43ec-8434-238611edd865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a8276017d140a9aeb5e6919cd654b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:06:13Z,use_quota=True,user_id='e28ce6f9adc44e079cc00c5c394650b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cfe682d-a708-4f47-9d18-46a118eae79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cfe682d-a708-4f47-9d18-46a118eae79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7621fb31-b6e2-48e4-96df-b5d4c32dc34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7621fb31-b6e2-48e4-96df-b5d4c32dc34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4410767e-1659-43ec-8434-238611edd865', 'volume_name': 'volume-4410767e-1659-43ec-8434-238611edd865', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa5fd8b-f23f-4c4c-ac9e-5e4f56b5c4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:13 devstack sudo[86375]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa5fd8b-f23f-4c4c-ac9e-5e4f56b5c4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a51ba5-256e-40d1-93ed-78cc575a317f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:13 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Volume 4410767e-1659-43ec-8434-238611edd865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4410767e-1659-43ec-8434-238611edd865', 'volume_size': 1} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.info" returned: 0 in 0.483s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.692s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1003455057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4410767e-1659-43ec-8434-238611edd865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a8276017d140a9aeb5e6919cd654b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:06:13Z,use_quota=True,user_id='e28ce6f9adc44e079cc00c5c394650b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Creating volume 4410767e-1659-43ec-8434-238611edd865 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:06:13 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4410767e-1659-43ec-8434-238611edd865 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:13 devstack sudo[86378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4410767e-1659-43ec-8434-238611edd865 1073741824 Apr 21 02:06:13 devstack sudo[86378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:13 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-9b05ba15-6b95-447d-9348-56f846da0113 tempest-VolumesDeleteCascade-1259797710 None] Create snapshot completed successfully Apr 21 02:06:13 devstack sudo[86378]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4410767e-1659-43ec-8434-238611edd865 1073741824" returned: 0 in 0.587s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4410767e-1659-43ec-8434-238611edd865 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:13 devstack sudo[86383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4410767e-1659-43ec-8434-238611edd865 Apr 21 02:06:13 devstack sudo[86383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Flow 'volume_create_manager' (e224b1a8-7b88-43df-8806-5cc3ba500ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d37c8a-1330-4360-af84-8698ae528598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d37c8a-1330-4360-af84-8698ae528598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-361054711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ffe764129e49f08547a22ab3b14e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8264e3a0-9708-4a92-8613-e15a9331f59b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:06:14Z,use_quota=True,user_id='e47c2d5df4d24e61bebed1ffbaf821d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90283cdf-7a04-43d2-be94-452e6e876e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90283cdf-7a04-43d2-be94-452e6e876e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d9eca8-902f-4b70-9e9c-6596727e6075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d9eca8-902f-4b70-9e9c-6596727e6075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3', 'volume_name': 'volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3', 'volume_size': 1, 'snapshot_id': '8264e3a0-9708-4a92-8613-e15a9331f59b'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99043a3c-948b-477d-b856-3222a2ce352e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99043a3c-948b-477d-b856-3222a2ce352e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2705a43d-b204-4f9b-9933-0929d98c1e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:14 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Volume 7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3', 'volume_size': 1, 'snapshot_id': '8264e3a0-9708-4a92-8613-e15a9331f59b'} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:14 devstack sudo[86383]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4410767e-1659-43ec-8434-238611edd865" returned: 0 in 0.555s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.296s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "cinder-quobyte-8264e3a0-9708-4a92-8613-e15a9331f59b-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3" by "_create_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a51ba5-256e-40d1-93ed-78cc575a317f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4410767e-1659-43ec-8434-238611edd865', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd7d470-856e-4433-bf12-89c3cc62a797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:14 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Volume volume-4410767e-1659-43ec-8434-238611edd865 (4410767e-1659-43ec-8434-238611edd865): created successfully Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd7d470-856e-4433-bf12-89c3cc62a797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Flow 'volume_create_manager' (0fc99791-8e76-40a2-ab12-c2bd3d0e6988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:06:14 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-4d34e3ee-3882-45a9-82ea-7c515f0bfd4f tempest-VolumesTransfersTest-112986195 None] Created volume successfully. Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-8264e3a0-9708-4a92-8613-e15a9331f59b-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Creating volume 7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3 from snapshot 8264e3a0-9708-4a92-8613-e15a9331f59b {{(pid=82184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "cinder-quobyte-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3" by "_copy_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] snapshot: 8264e3a0-9708-4a92-8613-e15a9331f59b, volume: 7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3, {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8118e6f-eaf8-4d41-b60d-ae2a229a24ef]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:14 devstack sudo[86392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b Apr 21 02:06:14 devstack sudo[86392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:15 devstack sudo[86392]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b" returned: 0 in 0.585s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1fce9b0-6575-429c-be5c-05096b247caa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:06:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 02:06:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Creating direct copy from snapshot {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 02:06:15 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb07dad6-7018-4cca-9fee-d8e8727503f3]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:15 devstack sudo[86417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa Apr 21 02:06:15 devstack sudo[86417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] Acquiring lock "cinder-4410767e-1659-43ec-8434-238611edd865-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] Lock "cinder-4410767e-1659-43ec-8434-238611edd865-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] Acquiring lock "cinder-quobyte-4410767e-1659-43ec-8434-238611edd865" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] Lock "cinder-quobyte-4410767e-1659-43ec-8434-238611edd865" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:15 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f8de1a-de4f-402a-8939-0d02ef71bb6f]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4410767e-1659-43ec-8434-238611edd865 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:15 devstack sudo[86440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4410767e-1659-43ec-8434-238611edd865 Apr 21 02:06:15 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:16 devstack sudo[86417]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa" returned: 0 in 0.960s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:16 devstack cinder-volume[82184]: DEBUG cinder.utils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Path /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3 not found in is_blk_device check {{(pid=82184) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 02:06:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:16 devstack sudo[86446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3 Apr 21 02:06:16 devstack sudo[86446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:16 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4410767e-1659-43ec-8434-238611edd865" returned: 0 in 0.866s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4410767e-1659-43ec-8434-238611edd865 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:16 devstack sudo[86456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4410767e-1659-43ec-8434-238611edd865 Apr 21 02:06:16 devstack sudo[86456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:18 devstack sudo[86456]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4410767e-1659-43ec-8434-238611edd865" returned: 0 in 1.493s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:18 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] Lock "cinder-quobyte-4410767e-1659-43ec-8434-238611edd865" released by "delete_volume" :: held 2.413s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:18 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] Created reservations ['76644833-7022-4df3-984c-d45b1cf6c03f', 'c7b5c773-1758-4fe4-8bb6-4552735975ba', '3bfa7833-3667-46aa-8a1e-e7365398c9d0', '36172c03-9bb3-477f-91d5-a8eec0ccd76a'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:06:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:18 devstack sudo[86498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:06:18 devstack sudo[86498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:19 devstack sudo[86446]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3" returned: 0 in 3.787s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:19 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28999d0-dc0c-45c7-8ca1-42a83ccee7b1]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:19 devstack sudo[86498]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 1.618s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:19 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:06:19 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] Deleted volume successfully. Apr 21 02:06:20 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a4cd7b35-3fea-45a8-95f2-7e7d62ab3afe tempest-VolumesTransfersTest-161725844 None] Lock "cinder-4410767e-1659-43ec-8434-238611edd865-delete_volume" released by "delete_volume" :: held 4.386s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:20 devstack sudo[86522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa Apr 21 02:06:20 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:20 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa" returned: 0 in 0.780s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:20 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Image conversion details: src /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa, size 1024.00 MB, duration 3.79 sec, destination /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3 {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:06:20 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Converted 1024.00 MB image at 270.20 MB/s Apr 21 02:06:20 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3 is being set with open permissions: ugo+rw Apr 21 02:06:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:20 devstack sudo[86530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3 Apr 21 02:06:20 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:21 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3" returned: 0 in 0.560s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3" released by "_copy_volume_from_snapshot" :: held 6.766s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-8264e3a0-9708-4a92-8613-e15a9331f59b-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3" released by "_create_volume_from_snapshot" :: held 6.787s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.821s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2705a43d-b204-4f9b-9933-0929d98c1e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3', 'volume_size': 1, 'snapshot_id': '8264e3a0-9708-4a92-8613-e15a9331f59b'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1479354-af09-4391-bd76-123d7bc21188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:21 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Volume volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3 (7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3): created successfully Apr 21 02:06:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1479354-af09-4391-bd76-123d7bc21188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Flow 'volume_create_manager' (e224b1a8-7b88-43df-8806-5cc3ba500ee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:06:21 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-5456cf2c-49e1-4da2-975f-e9806c21681b tempest-VolumesDeleteCascade-1259797710 None] Created volume successfully. Apr 21 02:06:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "cinder-b1fce9b0-6575-429c-be5c-05096b247caa-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-b1fce9b0-6575-429c-be5c-05096b247caa-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Performing cascade delete. {{(pid=82184) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "cinder-8264e3a0-9708-4a92-8613-e15a9331f59b-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-8264e3a0-9708-4a92-8613-e15a9331f59b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "cinder-quobyte-b1fce9b0-6575-429c-be5c-05096b247caa" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:22 devstack cinder-volume[82184]: INFO cinder.volume.manager [req-0e512401-7be5-47dc-a483-440931a53224 req-4fba8dd2-6381-4c0b-b26b-6174e777b08c tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Terminate volume connection completed successfully. Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-0e512401-7be5-47dc-a483-440931a53224 req-4fba8dd2-6381-4c0b-b26b-6174e777b08c tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Deleting attachment f15600d8-d3dd-4fe2-b312-df3f7ba608cb. {{(pid=82184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-b1fce9b0-6575-429c-be5c-05096b247caa" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "cinder-quobyte-8264e3a0-9708-4a92-8613-e15a9331f59b" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-8264e3a0-9708-4a92-8613-e15a9331f59b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Deleting offline snapshot 8264e3a0-9708-4a92-8613-e15a9331f59b of volume b1fce9b0-6575-429c-be5c-05096b247caa {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] snapshot_file for this snap is: volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeacf08-2dea-4f0c-8dd3-aca5f9066cce]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:22 devstack sudo[86540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b Apr 21 02:06:22 devstack sudo[86540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Acquiring lock "cinder-e290343d-56d7-4040-9af1-d989e41d4ea1-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "cinder-e290343d-56d7-4040-9af1-d989e41d4ea1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Acquiring lock "cinder-quobyte-e290343d-56d7-4040-9af1-d989e41d4ea1" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "cinder-quobyte-e290343d-56d7-4040-9af1-d989e41d4ea1" acquired by "delete_volume" :: waited 0.019s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13f2db2-50ad-4e6f-bf54-e7b70cb59084]: (4, 'raw') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:23 devstack sudo[86570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 Apr 21 02:06:23 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:23 devstack sudo[86540]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b" returned: 0 in 0.979s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1fce9b0-6575-429c-be5c-05096b247caa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:06:23 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3f67f8-5693-430b-b085-6288530eb3d7]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:23 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa Apr 21 02:06:23 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:23 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1" returned: 0 in 0.984s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:24 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa" returned: 0 in 0.955s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:24 devstack sudo[86600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b Apr 21 02:06:24 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:24 devstack sudo[86597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 Apr 21 02:06:24 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Flow 'volume_create_manager' (3bcb2b38-8255-4d2d-b1a6-5f7998414dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74b60a9-92ac-4a7c-aa4d-d89d57dc8cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74b60a9-92ac-4a7c-aa4d-d89d57dc8cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2046352542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cf114d-1b39-4f36-955b-0a03192a7d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88ebdaf86794221ad1bdd8844dd329f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:06:24Z,use_quota=True,user_id='d1e246253cd041f0aa8227551d2e3040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9281332b-520a-4852-b39f-a81c025bc401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9281332b-520a-4852-b39f-a81c025bc401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ffabeb-25c8-44ef-99fe-18408e69f578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ffabeb-25c8-44ef-99fe-18408e69f578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55cf114d-1b39-4f36-955b-0a03192a7d2b', 'volume_name': 'volume-55cf114d-1b39-4f36-955b-0a03192a7d2b', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a759c28e-b2b2-4b0c-bb83-903a10d37624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a759c28e-b2b2-4b0c-bb83-903a10d37624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a410b6-089e-46f0-b523-8d061b451673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:24 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Volume 55cf114d-1b39-4f36-955b-0a03192a7d2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55cf114d-1b39-4f36-955b-0a03192a7d2b', 'volume_size': 1} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2046352542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cf114d-1b39-4f36-955b-0a03192a7d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88ebdaf86794221ad1bdd8844dd329f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:06:24Z,use_quota=True,user_id='d1e246253cd041f0aa8227551d2e3040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Creating volume 55cf114d-1b39-4f36-955b-0a03192a7d2b {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:06:24 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:24 devstack sudo[86604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b 1073741824 Apr 21 02:06:24 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:24 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1" returned: 1 in 0.732s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1' failed. Not Retrying. {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:24 devstack sudo[86609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1 Apr 21 02:06:24 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:24 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b" returned: 0 in 0.912s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:25 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b Apr 21 02:06:25 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:25 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b 1073741824" returned: 0 in 0.650s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:25 devstack sudo[86621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b Apr 21 02:06:25 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:25 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e290343d-56d7-4040-9af1-d989e41d4ea1" returned: 0 in 0.581s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "cinder-quobyte-e290343d-56d7-4040-9af1-d989e41d4ea1" released by "delete_volume" :: held 2.397s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG cinder.quota [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Created reservations ['f180633c-d05a-431d-820c-9dad5ef95a5d', '8cf4280b-6c8b-48a9-8e28-44f03f55d6dd', 'f8670a74-c07c-42c1-94dc-55aa7c7012b1', 'ab4c20cb-b9a3-4f1e-9dc4-56f6a70e31b3'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:25 devstack sudo[86625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:06:25 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:25 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa.8264e3a0-9708-4a92-8613-e15a9331f59b" returned: 0 in 0.653s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-8264e3a0-9708-4a92-8613-e15a9331f59b" released by "_delete_snapshot" :: held 3.558s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-b1fce9b0-6575-429c-be5c-05096b247caa" released by "delete_snapshot" :: held 3.570s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:25 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b" returned: 0 in 0.533s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a410b6-089e-46f0-b523-8d061b451673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55cf114d-1b39-4f36-955b-0a03192a7d2b', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85c5373-6e93-445d-8dce-f4adaba27c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:25 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Volume volume-55cf114d-1b39-4f36-955b-0a03192a7d2b (55cf114d-1b39-4f36-955b-0a03192a7d2b): created successfully Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85c5373-6e93-445d-8dce-f4adaba27c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Flow 'volume_create_manager' (3bcb2b38-8255-4d2d-b1a6-5f7998414dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:06:25 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-545c03cd-d261-418e-ae05-1241e57df197 tempest-VolumesCloneTest-734295190 None] Created volume successfully. Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Created reservations ['7f471545-95d2-4352-a531-e804ddff076d', 'd35393f8-f3c9-4df0-a185-f884ba7ee0d5', 'db180082-731f-466e-af86-e80dc700af7a', 'a8000387-489e-4ed1-b87c-f0d48e87eeeb'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:06:25 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Delete snapshot completed successfully. Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-8264e3a0-9708-4a92-8613-e15a9331f59b-delete_snapshot" released by "delete_snapshot" :: held 3.875s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Snapshots deleted, issuing volume delete {{(pid=82184) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "cinder-quobyte-b1fce9b0-6575-429c-be5c-05096b247caa" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-b1fce9b0-6575-429c-be5c-05096b247caa" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-cd49e1b8-a00c-4c27-945f-b0c332930ee9 tempest-VolumesActionsTest-1192287018 None] Acquiring lock "cinder-273da430-61af-4702-ba70-1dfed29fcc52" by "attach_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54dbaa2-5947-46cb-a8a5-cccd51392674]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-cd49e1b8-a00c-4c27-945f-b0c332930ee9 tempest-VolumesActionsTest-1192287018 None] Lock "cinder-273da430-61af-4702-ba70-1dfed29fcc52" acquired by "attach_volume" :: waited 0.024s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:26 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-cd49e1b8-a00c-4c27-945f-b0c332930ee9 tempest-VolumesActionsTest-1192287018 None] Attaching volume 273da430-61af-4702-ba70-1dfed29fcc52 to instance 46279105-d5d5-4dc4-91b0-3a86bd00900d at mountpoint /dev/vdb on host None. Apr 21 02:06:26 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-cd49e1b8-a00c-4c27-945f-b0c332930ee9 tempest-VolumesActionsTest-1192287018 None] Attach volume completed successfully. Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-cd49e1b8-a00c-4c27-945f-b0c332930ee9 tempest-VolumesActionsTest-1192287018 None] Lock "cinder-273da430-61af-4702-ba70-1dfed29fcc52" released by "attach_volume" :: held 0.060s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:26 devstack sudo[86629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa Apr 21 02:06:26 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:26 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.750s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.manager [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:06:26 devstack cinder-volume[82184]: INFO cinder.volume.manager [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Deleted volume successfully. Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-0e512401-7be5-47dc-a483-440931a53224 req-5eb3b910-2a3c-4077-8289-22ae3346d7f5 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "cinder-e290343d-56d7-4040-9af1-d989e41d4ea1-delete_volume" released by "delete_volume" :: held 3.471s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6cbcd354-e82e-4478-b484-4d0e7b6166a9 tempest-VolumesActionsTest-1192287018 None] Acquiring lock "cinder-273da430-61af-4702-ba70-1dfed29fcc52-detach_volume" by "detach_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:26 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Flow 'volume_create_manager' (3b061625-5086-46ee-aae3-6ebcd1dc1f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d88eab2-2ab4-448f-b43d-6d029a7632fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6cbcd354-e82e-4478-b484-4d0e7b6166a9 tempest-VolumesActionsTest-1192287018 None] Lock "cinder-273da430-61af-4702-ba70-1dfed29fcc52-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:26 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-6cbcd354-e82e-4478-b484-4d0e7b6166a9 tempest-VolumesActionsTest-1192287018 None] Detaching volume 273da430-61af-4702-ba70-1dfed29fcc52 from instance 46279105-d5d5-4dc4-91b0-3a86bd00900d. Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa" returned: 0 in 0.715s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:26 devstack sudo[86635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa Apr 21 02:06:26 devstack sudo[86635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d88eab2-2ab4-448f-b43d-6d029a7632fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-803489312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78afea2-510b-4ca9-aba6-233137e3d7a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88ebdaf86794221ad1bdd8844dd329f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:06:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=55cf114d-1b39-4f36-955b-0a03192a7d2b,status='creating',terminated_at=None,updated_at=2026-04-21T00:06:27Z,use_quota=True,user_id='d1e246253cd041f0aa8227551d2e3040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96074686-7166-46fc-8046-c1d5282eb149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96074686-7166-46fc-8046-c1d5282eb149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e6f810-dbb5-4483-b7f5-7e5631f31b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e6f810-dbb5-4483-b7f5-7e5631f31b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd78afea2-510b-4ca9-aba6-233137e3d7a0', 'volume_name': 'volume-d78afea2-510b-4ca9-aba6-233137e3d7a0', 'volume_size': 2, 'source_volid': '55cf114d-1b39-4f36-955b-0a03192a7d2b', 'source_volstatus': 'available'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80404672-fa3f-48e1-b339-7b2dbc4eb052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80404672-fa3f-48e1-b339-7b2dbc4eb052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e30950-9661-456a-b377-3fb3a2d1b0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:26 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Volume d78afea2-510b-4ca9-aba6-233137e3d7a0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d78afea2-510b-4ca9-aba6-233137e3d7a0', 'volume_size': 2, 'source_volid': '55cf114d-1b39-4f36-955b-0a03192a7d2b', 'source_volstatus': 'available'} Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:26 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Cloning volume 55cf114d-1b39-4f36-955b-0a03192a7d2b to volume d78afea2-510b-4ca9-aba6-233137e3d7a0 Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Creating offline snapshot 4fb3e50e-bfe2-4767-8d7d-ed65301f12bd of volume 55cf114d-1b39-4f36-955b-0a03192a7d2b {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:06:26 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-6cbcd354-e82e-4478-b484-4d0e7b6166a9 tempest-VolumesActionsTest-1192287018 None] Detach volume completed successfully. Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[609117e9-32fb-4c3d-9720-aeb33b67eb0c]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:26 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6cbcd354-e82e-4478-b484-4d0e7b6166a9 tempest-VolumesActionsTest-1192287018 None] Lock "cinder-273da430-61af-4702-ba70-1dfed29fcc52-detach_volume" released by "detach_volume" :: held 0.152s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:26 devstack sudo[86637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b Apr 21 02:06:26 devstack sudo[86637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:27 devstack sudo[86635]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b1fce9b0-6575-429c-be5c-05096b247caa" returned: 0 in 0.695s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:27 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-b1fce9b0-6575-429c-be5c-05096b247caa" released by "delete_volume" :: held 1.470s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:27 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Created reservations ['759f9f26-7627-466e-9934-9cbfb3aaf968', '7cb272a7-0ef5-4a8b-835f-d8a48c6c810d', '23c6ac26-98cb-4dfd-a057-563c6d1a1b2b', '0bd703c8-566c-4a59-aeca-d99345b19212'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:06:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:27 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:06:27 devstack sudo[86637]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:27 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b" returned: 0 in 0.800s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:27 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd 1G Apr 21 02:06:27 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:27 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "cinder-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:27 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:27 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "cinder-quobyte-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:27 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:27 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd97316f-14cd-47fb-be80-f4b8ae2b683b]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:28 devstack sudo[86676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3 Apr 21 02:06:28 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:28 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.569s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:28 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:06:28 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Deleted volume successfully. Apr 21 02:06:28 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9984951b-458a-4e93-afdf-bce150b62d96 tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-b1fce9b0-6575-429c-be5c-05096b247caa-delete_volume" released by "delete_volume" :: held 6.142s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:28 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd 1G" returned: 0 in 0.649s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55cf114d-1b39-4f36-955b-0a03192a7d2b -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:28 devstack sudo[86683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55cf114d-1b39-4f36-955b-0a03192a7d2b -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd Apr 21 02:06:28 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:28 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3" returned: 0 in 0.723s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:28 devstack sudo[86711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3 Apr 21 02:06:28 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:28 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55cf114d-1b39-4f36-955b-0a03192a7d2b -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd" returned: 0 in 0.687s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:28 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd is being set with open permissions: ugo+rw Apr 21 02:06:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:29 devstack sudo[86718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd Apr 21 02:06:29 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:29 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3" returned: 0 in 0.496s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:29 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-quobyte-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3" released by "delete_volume" :: held 1.254s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:29 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] Created reservations ['786533cc-485c-4a9a-9c3e-b0d4c417dac4', '3f455c8a-0ba4-40da-b663-445d499c4fd8', 'a9bd0892-55aa-4782-b735-259edac00cce', 'e674f6e0-1fd4-44db-a024-dee55366803c'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:06:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:29 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:29 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:29 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:06:29 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:29 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd" returned: 0 in 0.460s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:29 devstack sudo[86726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.info Apr 21 02:06:29 devstack sudo[86726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:29 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.414s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:29 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:06:29 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] Deleted volume successfully. Apr 21 02:06:29 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4db4b25b-e553-48b4-bf52-0abc64cac6fb tempest-VolumesDeleteCascade-1259797710 None] Lock "cinder-7f1c64d1-2fe7-4a05-bc0d-89bb6bbd6ca3-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:29 devstack sudo[86726]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.info" returned: 0 in 0.446s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:29 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.info is being set with open permissions: ugo+rw Apr 21 02:06:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:29 devstack sudo[86731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.info Apr 21 02:06:29 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:30 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.info" returned: 0 in 0.546s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:30 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Acquiring lock "cinder-quobyte-d78afea2-510b-4ca9-aba6-233137e3d7a0" by "_copy_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:30 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Lock "cinder-quobyte-d78afea2-510b-4ca9-aba6-233137e3d7a0" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:30 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] snapshot: 4fb3e50e-bfe2-4767-8d7d-ed65301f12bd, volume: d78afea2-510b-4ca9-aba6-233137e3d7a0, {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 02:06:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:30 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:30 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:30 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb17a17-d56e-423d-93bd-74b5de14bac2]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:30 devstack sudo[86735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd Apr 21 02:06:30 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:31 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd" returned: 0 in 0.587s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55cf114d-1b39-4f36-955b-0a03192a7d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:06:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 02:06:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Creating direct copy from snapshot {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 02:06:31 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bbebbd-8c8f-4e5d-8ef9-faca11fcac49]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:31 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b Apr 21 02:06:31 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:31 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b" returned: 0 in 0.535s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:31 devstack cinder-volume[82184]: DEBUG cinder.utils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Path /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d78afea2-510b-4ca9-aba6-233137e3d7a0 not found in is_blk_device check {{(pid=82184) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 02:06:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d78afea2-510b-4ca9-aba6-233137e3d7a0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:31 devstack sudo[86746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d78afea2-510b-4ca9-aba6-233137e3d7a0 Apr 21 02:06:31 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:32 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:06:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Flow 'volume_create_manager' (89c2dd96-86ea-4b8b-9b7a-9f7b55e6e740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:06:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc61976-d8bb-4bdb-8ac2-4fddf60eef22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc61976-d8bb-4bdb-8ac2-4fddf60eef22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1662558154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21127549-61c0-4506-8066-bf04ad9089d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e35caae10724598a98aa320fde9f0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:06:32Z,use_quota=True,user_id='5696ada496764f9c902070c5eecd4fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deba561a-65f6-424a-b615-5d4c16797102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deba561a-65f6-424a-b615-5d4c16797102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824ba6b4-6c58-47d8-b541-c33841c195ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:32 devstack cinder-volume[82184]: DEBUG cinder.image.glance [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Creating Keystone auth plugin from conf {{(pid=82184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 02:06:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824ba6b4-6c58-47d8-b541-c33841c195ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '21127549-61c0-4506-8066-bf04ad9089d0', 'volume_name': 'volume-21127549-61c0-4506-8066-bf04ad9089d0', 'volume_size': 1, 'image_id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b9740a9418bf48ba9dad196958886690', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'created_at': datetime.datetime(2026, 4, 20, 23, 58, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 23, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b22600ee-9d9f-4ee7-8886-ce18034d260d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414c3e97-f637-478f-b120-22504a5daa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414c3e97-f637-478f-b120-22504a5daa09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d489ba5-d893-4acc-a0f4-ed7943d1d7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:32 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Volume 21127549-61c0-4506-8066-bf04ad9089d0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-21127549-61c0-4506-8066-bf04ad9089d0', 'volume_size': 1, 'image_id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b9740a9418bf48ba9dad196958886690', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'created_at': datetime.datetime(2026, 4, 20, 23, 58, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 23, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b22600ee-9d9f-4ee7-8886-ce18034d260d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 02:06:32 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Trying to clone 21127549-61c0-4506-8066-bf04ad9089d0 from image b22600ee-9d9f-4ee7-8886-ce18034d260d at location (None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}]). {{(pid=82184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 02:06:33 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__8_4fxy2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82184) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 02:06:33 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Image download 20.69 MB at 20.69 MB/s Apr 21 02:06:33 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f97f88f-01d8-4157-8dc5-a746cbdabe80]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__8_4fxy2devstack@QuobyteHD {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:33 devstack sudo[86784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__8_4fxy2devstack@QuobyteHD Apr 21 02:06:33 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:34 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d78afea2-510b-4ca9-aba6-233137e3d7a0" returned: 0 in 2.659s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:34 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a76960-fcd1-4e92-8dab-b6cf385eb810]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:34 devstack sudo[86789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b Apr 21 02:06:34 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:34 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__8_4fxy2devstack@QuobyteHD" returned: 0 in 1.063s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:34 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Temporary image b22600ee-9d9f-4ee7-8886-ce18034d260d is fetched for user 5696ada496764f9c902070c5eecd4fae. {{(pid=82184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 02:06:34 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bbabf5-66fb-48ba-9fe6-5af1662c3e8d]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__8_4fxy2devstack@QuobyteHD {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:34 devstack sudo[86797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__8_4fxy2devstack@QuobyteHD Apr 21 02:06:34 devstack sudo[86797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:34 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b" returned: 0 in 0.721s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:35 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Image conversion details: src /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b, size 1024.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d78afea2-510b-4ca9-aba6-233137e3d7a0 {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:06:35 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Converted 1024.00 MB image at 384.81 MB/s Apr 21 02:06:35 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d78afea2-510b-4ca9-aba6-233137e3d7a0 is being set with open permissions: ugo+rw Apr 21 02:06:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d78afea2-510b-4ca9-aba6-233137e3d7a0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:35 devstack sudo[86806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d78afea2-510b-4ca9-aba6-233137e3d7a0 Apr 21 02:06:35 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:35 devstack sudo[86797]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__8_4fxy2devstack@QuobyteHD" returned: 0 in 0.510s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:35 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d78afea2-510b-4ca9-aba6-233137e3d7a0" returned: 0 in 0.457s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Lock "cinder-quobyte-d78afea2-510b-4ca9-aba6-233137e3d7a0" released by "_copy_volume_from_snapshot" :: held 5.004s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Acquiring lock "cinder-quobyte-4fb3e50e-bfe2-4767-8d7d-ed65301f12bd" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Lock "cinder-quobyte-4fb3e50e-bfe2-4767-8d7d-ed65301f12bd" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Deleting offline snapshot 4fb3e50e-bfe2-4767-8d7d-ed65301f12bd of volume 55cf114d-1b39-4f36-955b-0a03192a7d2b {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:06:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] snapshot_file for this snap is: volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:06:35 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a844237-daa7-4d15-b766-ee5a2d48b6fe]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:35 devstack sudo[86812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd Apr 21 02:06:35 devstack sudo[86812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:35 devstack cinder-volume[82184]: INFO cinder.volume.manager [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-2e8c9af0-9432-474a-bfe7-6f4cfb157c50 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Terminate volume connection completed successfully. Apr 21 02:06:35 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-2e8c9af0-9432-474a-bfe7-6f4cfb157c50 tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Deleting attachment 0fcdb10b-0523-4e5d-988b-2b1105b40c01. {{(pid=82184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 21 02:06:36 devstack sudo[86812]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd" returned: 0 in 0.502s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55cf114d-1b39-4f36-955b-0a03192a7d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:06:36 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1effbe9-5aad-4957-a88b-e1e2fbd4dc8f]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:36 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b Apr 21 02:06:36 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-85388663-6414-480c-9f65-bb9b01b15dbd tempest-VolumesActionsTest-1192287018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:36 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Acquiring lock "cinder-69857c73-f416-4871-988f-18b0048b492c-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:36 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "cinder-69857c73-f416-4871-988f-18b0048b492c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:36 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Acquiring lock "cinder-quobyte-69857c73-f416-4871-988f-18b0048b492c" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:36 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "cinder-quobyte-69857c73-f416-4871-988f-18b0048b492c" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:36 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b91eb6-55a3-45ce-a1f9-9945f0fd04ca]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-69857c73-f416-4871-988f-18b0048b492c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:36 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b" returned: 0 in 0.571s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:36 devstack sudo[86823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd Apr 21 02:06:36 devstack sudo[86823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:36 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-69857c73-f416-4871-988f-18b0048b492c Apr 21 02:06:36 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:37 devstack sudo[86823]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd" returned: 0 in 0.458s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:37 devstack sudo[86832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd Apr 21 02:06:37 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:37 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-69857c73-f416-4871-988f-18b0048b492c" returned: 0 in 0.534s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-69857c73-f416-4871-988f-18b0048b492c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:37 devstack sudo[86834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-69857c73-f416-4871-988f-18b0048b492c Apr 21 02:06:37 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:37 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b.4fb3e50e-bfe2-4767-8d7d-ed65301f12bd" returned: 0 in 0.447s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Lock "cinder-quobyte-4fb3e50e-bfe2-4767-8d7d-ed65301f12bd" released by "_delete_snapshot" :: held 2.031s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:37 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-69857c73-f416-4871-988f-18b0048b492c" returned: 0 in 0.433s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.747s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.398s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1662558154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21127549-61c0-4506-8066-bf04ad9089d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e35caae10724598a98aa320fde9f0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:06:32Z,use_quota=True,user_id='5696ada496764f9c902070c5eecd4fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Creating volume 21127549-61c0-4506-8066-bf04ad9089d0 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:06:37 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "cinder-quobyte-69857c73-f416-4871-988f-18b0048b492c" released by "delete_volume" :: held 1.012s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e30950-9661-456a-b377-3fb3a2d1b0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78afea2-510b-4ca9-aba6-233137e3d7a0', 'volume_size': 2, 'source_volid': '55cf114d-1b39-4f36-955b-0a03192a7d2b', 'source_volstatus': 'available'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:37 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 1073741824 Apr 21 02:06:37 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31204309-c11d-41d7-9f26-71d9f993b52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:37 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Volume volume-d78afea2-510b-4ca9-aba6-233137e3d7a0 (d78afea2-510b-4ca9-aba6-233137e3d7a0): created successfully Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31204309-c11d-41d7-9f26-71d9f993b52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Flow 'volume_create_manager' (3b061625-5086-46ee-aae3-6ebcd1dc1f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG cinder.quota [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Created reservations ['5dad2d70-856b-49c3-8065-f0741c0f1c68', 'c3648180-d24d-461f-99c9-787467540dd2', '35524575-2d2b-490c-86f2-004b4274964e', 'd1513ae7-517e-4a47-a602-509d456c6fbc'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:06:37 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-343fd472-e7d6-447a-b0eb-cd886d98d710 tempest-VolumesCloneTest-734295190 None] Created volume successfully. Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:37 devstack sudo[86840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:06:37 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:38 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 1073741824" returned: 0 in 0.505s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:38 devstack sudo[86846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 Apr 21 02:06:38 devstack sudo[86846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:38 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.458s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG cinder.manager [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:06:38 devstack cinder-volume[82184]: INFO cinder.volume.manager [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Deleted volume successfully. Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-8bb9a9be-667c-46fb-ba41-09f0db8e1423 req-0056fc15-3510-480f-83c2-24f42d2c834b tempest-ServerBootFromVolumeStableRescueTest-1649074582 None] Lock "cinder-69857c73-f416-4871-988f-18b0048b492c-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:38 devstack sudo[86846]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0" returned: 0 in 0.436s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-85388663-6414-480c-9f65-bb9b01b15dbd tempest-VolumesActionsTest-1192287018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.170s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fa37a3-fb13-4c01-bfde-97fe744ecaf1]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-85388663-6414-480c-9f65-bb9b01b15dbd tempest-VolumesActionsTest-1192287018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG cinder.volume.volume_utils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Attempting download of b22600ee-9d9f-4ee7-8886-ce18034d260d ((None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}])) to volume 21127549-61c0-4506-8066-bf04ad9089d0. {{(pid=82184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e87da29-feff-4e3d-a247-6645a5b77419]: (4, 'raw') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_9v30gb6j {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:38 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 Apr 21 02:06:38 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:38 devstack sudo[86850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_9v30gb6j Apr 21 02:06:38 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] Acquiring lock "cinder-d78afea2-510b-4ca9-aba6-233137e3d7a0-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] Lock "cinder-d78afea2-510b-4ca9-aba6-233137e3d7a0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG oslo_service.periodic_task [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:38 devstack sudo[86853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:06:38 devstack sudo[86853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] Acquiring lock "cinder-quobyte-d78afea2-510b-4ca9-aba6-233137e3d7a0" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] Lock "cinder-quobyte-d78afea2-510b-4ca9-aba6-233137e3d7a0" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ff178d-4286-440e-a66d-f898e3170064]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d78afea2-510b-4ca9-aba6-233137e3d7a0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:38 devstack sudo[86855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d78afea2-510b-4ca9-aba6-233137e3d7a0 Apr 21 02:06:38 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:39 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-85388663-6414-480c-9f65-bb9b01b15dbd tempest-VolumesActionsTest-1192287018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52" returned: 0 in 0.692s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c0f07f-cfed-47ba-96e0-245f9a1327c0]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-85388663-6414-480c-9f65-bb9b01b15dbd tempest-VolumesActionsTest-1192287018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:39 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_9v30gb6j" returned: 0 in 0.660s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_9v30gb6j {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:39 devstack sudo[86863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 Apr 21 02:06:39 devstack sudo[86863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:39 devstack sudo[86853]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:39 devstack sudo[86867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_9v30gb6j Apr 21 02:06:39 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.602s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:06:39 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d78afea2-510b-4ca9-aba6-233137e3d7a0" returned: 0 in 0.573s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d78afea2-510b-4ca9-aba6-233137e3d7a0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:39 devstack sudo[86871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d78afea2-510b-4ca9-aba6-233137e3d7a0 Apr 21 02:06:39 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:39 devstack sudo[86863]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-85388663-6414-480c-9f65-bb9b01b15dbd tempest-VolumesActionsTest-1192287018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52" returned: 0 in 0.549s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-85388663-6414-480c-9f65-bb9b01b15dbd tempest-VolumesActionsTest-1192287018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.f32279f8-2624-4445-8ecb-577f3ecbf2affeake6gr.img {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:39 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_9v30gb6j" returned: 1 in 0.538s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_9v30gb6j' failed. Not Retrying. {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8f6767-f2aa-4bf3-8d49-de5b79cd80ab]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__8_4fxy2devstack@QuobyteHD {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:39 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:39 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.f32279f8-2624-4445-8ecb-577f3ecbf2affeake6gr.img Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d78afea2-510b-4ca9-aba6-233137e3d7a0" returned: 0 in 0.446s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:39 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] Lock "cinder-quobyte-d78afea2-510b-4ca9-aba6-233137e3d7a0" released by "delete_volume" :: held 1.044s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] Created reservations ['4fb3736b-0bba-48a7-b044-19283d2f3d43', 'b832965c-4c0e-4099-9dd4-526f43a72de4', '74678a0c-2aeb-4c23-bc89-e43b06a94eba', '35850dd7-168f-4452-9def-60f613ca3bb4'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:06:39 devstack sudo[86880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__8_4fxy2devstack@QuobyteHD Apr 21 02:06:39 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:39 devstack sudo[86883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:06:39 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:40 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.655s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:40 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:06:40 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] Deleted volume successfully. Apr 21 02:06:40 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fb9a27dd-01ee-46f0-ab0f-34c3380fd4c2 tempest-VolumesCloneTest-734295190 None] Lock "cinder-d78afea2-510b-4ca9-aba6-233137e3d7a0-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__8_4fxy2devstack@QuobyteHD" returned: 0 in 1.157s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:40 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] b22600ee-9d9f-4ee7-8886-ce18034d260d was qcow2, converting to raw {{(pid=82184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 02:06:40 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__8_4fxy2devstack@QuobyteHD /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:41 devstack sudo[86928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__8_4fxy2devstack@QuobyteHD /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 Apr 21 02:06:41 devstack sudo[86928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:41 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] Acquiring lock "cinder-55cf114d-1b39-4f36-955b-0a03192a7d2b-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:41 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] Lock "cinder-55cf114d-1b39-4f36-955b-0a03192a7d2b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:41 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] Acquiring lock "cinder-quobyte-55cf114d-1b39-4f36-955b-0a03192a7d2b" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:41 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] Lock "cinder-quobyte-55cf114d-1b39-4f36-955b-0a03192a7d2b" acquired by "delete_volume" :: waited 0.021s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:41 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[23704da1-291e-4551-be01-c2c3f9140d16]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:41 devstack sudo[86930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b Apr 21 02:06:41 devstack sudo[86930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:42 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-85388663-6414-480c-9f65-bb9b01b15dbd tempest-VolumesActionsTest-1192287018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.f32279f8-2624-4445-8ecb-577f3ecbf2affeake6gr.img" returned: 0 in 2.466s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:42 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[900ac29d-847f-4105-bdeb-d178b57bc8cf]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-85388663-6414-480c-9f65-bb9b01b15dbd tempest-VolumesActionsTest-1192287018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:42 devstack sudo[86937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 Apr 21 02:06:42 devstack sudo[86937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:42 devstack sudo[86930]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b" returned: 0 in 1.086s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:42 devstack sudo[86945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b Apr 21 02:06:42 devstack sudo[86945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:42 devstack sudo[86928]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__8_4fxy2devstack@QuobyteHD /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0" returned: 0 in 1.804s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:42 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d__8_4fxy2devstack@QuobyteHD, size 112.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:06:42 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Converted 112.00 MB image at 62.04 MB/s Apr 21 02:06:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:42 devstack sudo[86949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 1G Apr 21 02:06:42 devstack sudo[86949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:42 devstack sudo[86945]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-55cf114d-1b39-4f36-955b-0a03192a7d2b" returned: 0 in 0.481s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:42 devstack sudo[86937]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-85388663-6414-480c-9f65-bb9b01b15dbd tempest-VolumesActionsTest-1192287018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52" returned: 0 in 0.742s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:42 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-85388663-6414-480c-9f65-bb9b01b15dbd tempest-VolumesActionsTest-1192287018 None] Image conversion details: src /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.f32279f8-2624-4445-8ecb-577f3ecbf2affeake6gr.img {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:06:42 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-85388663-6414-480c-9f65-bb9b01b15dbd tempest-VolumesActionsTest-1192287018 None] Converted 1024.00 MB image at 415.08 MB/s Apr 21 02:06:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] Lock "cinder-quobyte-55cf114d-1b39-4f36-955b-0a03192a7d2b" released by "delete_volume" :: held 1.653s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:43 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-85388663-6414-480c-9f65-bb9b01b15dbd tempest-VolumesActionsTest-1192287018 None] f32279f8-2624-4445-8ecb-577f3ecbf2af was raw, no need to convert to raw {{(pid=82184) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 21 02:06:43 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] Created reservations ['ba34d7ba-909e-46a0-ba33-405c06afc766', '97586b15-2edf-459d-ab9a-b7c02ab606db', 'ae3b4ee9-84b3-49a5-b355-8e1ab5abb13a', '1bd9ae4f-8618-4d2b-a737-d89e466dce9d'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:06:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:43 devstack sudo[86953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:06:43 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:43 devstack sudo[86949]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 1G" returned: 0 in 0.509s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:43 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[359dd60a-afbb-471a-93c9-d23cd65e4b6f]: (4, 'raw') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:43 devstack sudo[86958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 Apr 21 02:06:43 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:43 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.544s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:43 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:06:43 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] Deleted volume successfully. Apr 21 02:06:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-16e2ae51-06ac-45e8-b717-5e6a4137fd60 tempest-VolumesCloneTest-734295190 None] Lock "cinder-55cf114d-1b39-4f36-955b-0a03192a7d2b-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:43 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0" returned: 0 in 0.526s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:43 devstack sudo[86963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 Apr 21 02:06:43 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:44 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0" returned: 1 in 0.635s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0' failed. Not Retrying. {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 02:06:44 devstack cinder-volume[82184]: DEBUG cinder.volume.volume_utils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Downloaded image b22600ee-9d9f-4ee7-8886-ce18034d260d ((None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}])) to volume 21127549-61c0-4506-8066-bf04ad9089d0 successfully. {{(pid=82184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 02:06:44 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Temporary image b22600ee-9d9f-4ee7-8886-ce18034d260d for user 5696ada496764f9c902070c5eecd4fae is deleted. {{(pid=82184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 02:06:44 devstack cinder-volume[82184]: DEBUG cinder.volume.volume_utils [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Marking volume 21127549-61c0-4506-8066-bf04ad9089d0 as bootable. {{(pid=82184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 02:06:44 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Copying metadata from image b22600ee-9d9f-4ee7-8886-ce18034d260d to 21127549-61c0-4506-8066-bf04ad9089d0. {{(pid=82184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 02:06:44 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Creating volume glance metadata for volume 21127549-61c0-4506-8066-bf04ad9089d0 backed by image b22600ee-9d9f-4ee7-8886-ce18034d260d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 02:06:44 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d489ba5-d893-4acc-a0f4-ed7943d1d7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21127549-61c0-4506-8066-bf04ad9089d0', 'volume_size': 1, 'image_id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b9740a9418bf48ba9dad196958886690', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'created_at': datetime.datetime(2026, 4, 20, 23, 58, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 23, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b22600ee-9d9f-4ee7-8886-ce18034d260d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:44 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48d8b1e-8d58-4b9b-a479-6b37fa0b5c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:44 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Volume volume-21127549-61c0-4506-8066-bf04ad9089d0 (21127549-61c0-4506-8066-bf04ad9089d0): created successfully Apr 21 02:06:44 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48d8b1e-8d58-4b9b-a479-6b37fa0b5c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:44 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Flow 'volume_create_manager' (89c2dd96-86ea-4b8b-9b7a-9f7b55e6e740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:06:44 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-4481f03f-ac92-4532-a5ec-ff86eb210a0e tempest-VolumesExtendTest-270199420 None] Created volume successfully. Apr 21 02:06:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5483c5ed-c969-4743-b163-9110e8549666 tempest-VolumesExtendTest-270199420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:45 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:06:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Flow 'volume_create_manager' (3a961f7d-09e0-4d3a-9cd0-eb087cd09624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:06:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8afb8a0c-8ba3-4799-a4b3-98a4872a2df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8afb8a0c-8ba3-4799-a4b3-98a4872a2df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-105998484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1956a91-689c-4f16-b38a-0bac38b9dfa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2048c3cd21684ff0a79a2b17bc042faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:06:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:06:46Z,use_quota=True,user_id='e8ecf3c7fa0f4af9a08670cedb15e76a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ee07aa-f06d-48f6-8cd4-7953479fa557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ee07aa-f06d-48f6-8cd4-7953479fa557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efca6db2-27d8-4ded-867f-f6b09290346d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efca6db2-27d8-4ded-867f-f6b09290346d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1956a91-689c-4f16-b38a-0bac38b9dfa8', 'volume_name': 'volume-f1956a91-689c-4f16-b38a-0bac38b9dfa8', 'volume_size': 2}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f729a81-b311-4995-8fe9-d1d69672632f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f729a81-b311-4995-8fe9-d1d69672632f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3892785-a80e-4601-a238-5738908571ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:45 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Volume f1956a91-689c-4f16-b38a-0bac38b9dfa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1956a91-689c-4f16-b38a-0bac38b9dfa8', 'volume_size': 2} Apr 21 02:06:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-85388663-6414-480c-9f65-bb9b01b15dbd tempest-VolumesActionsTest-1192287018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.412s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:53 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-85388663-6414-480c-9f65-bb9b01b15dbd tempest-VolumesActionsTest-1192287018 None] Uploaded volume to glance image-id: f32279f8-2624-4445-8ecb-577f3ecbf2af. {{(pid=82184) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 21 02:06:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5483c5ed-c969-4743-b163-9110e8549666 tempest-VolumesExtendTest-270199420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 8.600s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:53 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-85388663-6414-480c-9f65-bb9b01b15dbd tempest-VolumesActionsTest-1192287018 None] Copy volume to image completed successfully. Apr 21 02:06:53 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[98317f35-bb1e-419f-beb5-c53447bca206]: (4, 'raw') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5483c5ed-c969-4743-b163-9110e8549666 tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:54 devstack sudo[87011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 Apr 21 02:06:54 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:54 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5483c5ed-c969-4743-b163-9110e8549666 tempest-VolumesExtendTest-270199420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0" returned: 0 in 0.500s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5483c5ed-c969-4743-b163-9110e8549666 tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:54 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 Apr 21 02:06:54 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:55 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5483c5ed-c969-4743-b163-9110e8549666 tempest-VolumesExtendTest-270199420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0" returned: 1 in 0.551s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5483c5ed-c969-4743-b163-9110e8549666 tempest-VolumesExtendTest-270199420 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0' failed. Not Retrying. {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 02:06:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5483c5ed-c969-4743-b163-9110e8549666 tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 2G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5483c5ed-c969-4743-b163-9110e8549666 tempest-VolumesExtendTest-270199420 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 2G" returned: 0 in 0.051s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5483c5ed-c969-4743-b163-9110e8549666 tempest-VolumesExtendTest-270199420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.137s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.476s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-105998484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1956a91-689c-4f16-b38a-0bac38b9dfa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2048c3cd21684ff0a79a2b17bc042faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:06:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:06:46Z,use_quota=True,user_id='e8ecf3c7fa0f4af9a08670cedb15e76a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:06:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Creating volume f1956a91-689c-4f16-b38a-0bac38b9dfa8 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:06:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:06:55 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:06:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f1956a91-689c-4f16-b38a-0bac38b9dfa8 2147483648 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:55 devstack sudo[87024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f1956a91-689c-4f16-b38a-0bac38b9dfa8 2147483648 Apr 21 02:06:55 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:55 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-5483c5ed-c969-4743-b163-9110e8549666 tempest-VolumesExtendTest-270199420 None] Extend volume completed successfully. Apr 21 02:06:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:55 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f1956a91-689c-4f16-b38a-0bac38b9dfa8 2147483648" returned: 0 in 0.585s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f1956a91-689c-4f16-b38a-0bac38b9dfa8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:55 devstack sudo[87029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f1956a91-689c-4f16-b38a-0bac38b9dfa8 Apr 21 02:06:55 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] Acquiring lock "cinder-21127549-61c0-4506-8066-bf04ad9089d0-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] Lock "cinder-21127549-61c0-4506-8066-bf04ad9089d0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] Acquiring lock "cinder-quobyte-21127549-61c0-4506-8066-bf04ad9089d0" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] Lock "cinder-quobyte-21127549-61c0-4506-8066-bf04ad9089d0" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dc781c-0905-469c-9a9c-12579ff22e55]: (4, 'raw') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:56 devstack sudo[87031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 Apr 21 02:06:56 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:56 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f1956a91-689c-4f16-b38a-0bac38b9dfa8" returned: 0 in 0.642s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.745s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3892785-a80e-4601-a238-5738908571ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1956a91-689c-4f16-b38a-0bac38b9dfa8', 'volume_size': 2}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f43dfa-577e-4d33-b744-76b75397fe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea08827a-cec6-4a0f-ad94-eccc69cc0e40]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:56 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Volume volume-f1956a91-689c-4f16-b38a-0bac38b9dfa8 (f1956a91-689c-4f16-b38a-0bac38b9dfa8): created successfully Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f43dfa-577e-4d33-b744-76b75397fe4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Flow 'volume_create_manager' (3a961f7d-09e0-4d3a-9cd0-eb087cd09624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:06:56 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-5b7e5a9a-2cad-4427-9664-9f296398f113 tempest-VolumesCloneNegativeTest-864668369 None] Created volume successfully. Apr 21 02:06:56 devstack sudo[87034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 Apr 21 02:06:56 devstack sudo[87034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:56 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0" returned: 0 in 0.563s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:56 devstack sudo[87038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 Apr 21 02:06:56 devstack sudo[87038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:56 devstack sudo[87034]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52" returned: 0 in 0.629s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac2cfbc-f141-4aae-9da7-8ef66d1d7ce6]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:57 devstack sudo[87043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 Apr 21 02:06:57 devstack sudo[87043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:57 devstack sudo[87038]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0" returned: 1 in 0.551s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0' failed. Not Retrying. {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 02:06:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:57 devstack sudo[87048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0 Apr 21 02:06:57 devstack sudo[87048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:57 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] Acquiring lock "cinder-f1956a91-689c-4f16-b38a-0bac38b9dfa8-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:57 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] Lock "cinder-f1956a91-689c-4f16-b38a-0bac38b9dfa8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:57 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] Acquiring lock "cinder-quobyte-f1956a91-689c-4f16-b38a-0bac38b9dfa8" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:06:57 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] Lock "cinder-quobyte-f1956a91-689c-4f16-b38a-0bac38b9dfa8" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:06:57 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f3d667-edb7-4286-b0ac-3566ef9396af]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:06:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f1956a91-689c-4f16-b38a-0bac38b9dfa8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:57 devstack sudo[87050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f1956a91-689c-4f16-b38a-0bac38b9dfa8 Apr 21 02:06:57 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:57 devstack sudo[87043]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52" returned: 0 in 0.686s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.4edf8c95-41cb-4460-8dcc-751d9f28b197c5a7odyw.img {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:57 devstack sudo[87055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.4edf8c95-41cb-4460-8dcc-751d9f28b197c5a7odyw.img Apr 21 02:06:57 devstack sudo[87055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:57 devstack sudo[87048]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-21127549-61c0-4506-8066-bf04ad9089d0" returned: 0 in 0.505s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:57 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] Lock "cinder-quobyte-21127549-61c0-4506-8066-bf04ad9089d0" released by "delete_volume" :: held 1.662s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:57 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f1956a91-689c-4f16-b38a-0bac38b9dfa8" returned: 0 in 0.554s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f1956a91-689c-4f16-b38a-0bac38b9dfa8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:57 devstack sudo[87061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f1956a91-689c-4f16-b38a-0bac38b9dfa8 Apr 21 02:06:57 devstack sudo[87061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:58 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] Created reservations ['07fdfebb-1a3a-429a-87bd-35b01a5dd401', '8d23dbbe-6285-432c-8fc3-bb27ef326961', 'e6263409-da95-4fee-9629-380f6ce76da2', 'da932923-ecfd-40dd-a7f4-b06884ea4b34'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:06:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:58 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:58 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:58 devstack sudo[87076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:06:58 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:06:58 devstack sudo[87061]: pam_unix(sudo:session): session closed for user root Apr 21 02:06:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f1956a91-689c-4f16-b38a-0bac38b9dfa8" returned: 0 in 0.803s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:06:58 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] Lock "cinder-quobyte-f1956a91-689c-4f16-b38a-0bac38b9dfa8" released by "delete_volume" :: held 1.384s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:06:58 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] Created reservations ['6c9f48c0-fdb7-4d22-a552-7f76f3479164', '8c22d7eb-301d-4ea9-8241-75ef9d49d467', '5953d721-08ea-4f9c-bd74-0043c5fc6a98', '2243dede-4b4b-4bef-84dd-7afb85505ade'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:06:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:06:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:06:58 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:06:58 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:06:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:06:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:06:59 devstack sudo[87078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:06:59 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:00 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Flow 'volume_create_manager' (6c30d443-b043-4104-84e0-f21d661d56c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb19e1ad-4b71-41e0-85c8-249ef5e1fb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 1.516s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb19e1ad-4b71-41e0-85c8-249ef5e1fb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1251302349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be27d72e-dd33-4a0b-b010-4262078fbf21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e35caae10724598a98aa320fde9f0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:00Z,use_quota=True,user_id='5696ada496764f9c902070c5eecd4fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45195d80-a351-4665-a6bf-60dc62e6c252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45195d80-a351-4665-a6bf-60dc62e6c252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e031fa-8c98-40ae-9e06-cb77b28de70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e031fa-8c98-40ae-9e06-cb77b28de70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be27d72e-dd33-4a0b-b010-4262078fbf21', 'volume_name': 'volume-be27d72e-dd33-4a0b-b010-4262078fbf21', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57fe1f65-a6e8-42be-b999-b5bc7b8d6958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57fe1f65-a6e8-42be-b999-b5bc7b8d6958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f0158b-d870-423f-8d3c-9f8eb3f372c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:00 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Volume be27d72e-dd33-4a0b-b010-4262078fbf21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be27d72e-dd33-4a0b-b010-4262078fbf21', 'volume_size': 1} Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:00 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] Deleted volume successfully. Apr 21 02:07:00 devstack sudo[87055]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.4edf8c95-41cb-4460-8dcc-751d9f28b197c5a7odyw.img" returned: 0 in 2.517s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-64ce7cc3-4edf-4995-8f5d-e4928ff60116 tempest-VolumesExtendTest-270199420 None] Lock "cinder-21127549-61c0-4506-8066-bf04ad9089d0-delete_volume" released by "delete_volume" :: held 4.131s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50c999a-9a67-48ac-9a5a-45458486e755]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:00 devstack sudo[87082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 Apr 21 02:07:00 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:00 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 1.315s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:07:00 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] Deleted volume successfully. Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0af4b6db-e727-4ab5-a02c-ee63f1b5949c tempest-VolumesCloneNegativeTest-864668369 None] Lock "cinder-f1956a91-689c-4f16-b38a-0bac38b9dfa8-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:00 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52" returned: 0 in 0.778s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] Image conversion details: src /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52, size 1024.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.4edf8c95-41cb-4460-8dcc-751d9f28b197c5a7odyw.img {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:07:00 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] Converted 1024.00 MB image at 406.64 MB/s Apr 21 02:07:00 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] 4edf8c95-41cb-4460-8dcc-751d9f28b197 was raw, converting to qcow2 {{(pid=82184) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 21 02:07:01 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8974c02-5ace-4523-bccf-e23b9ecb15e1]: (4, 'raw') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.4edf8c95-41cb-4460-8dcc-751d9f28b197c5a7odyw.img {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:01 devstack sudo[87090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.4edf8c95-41cb-4460-8dcc-751d9f28b197c5a7odyw.img Apr 21 02:07:01 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:01 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.4edf8c95-41cb-4460-8dcc-751d9f28b197c5a7odyw.img" returned: 0 in 0.571s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.4edf8c95-41cb-4460-8dcc-751d9f28b197c5a7odyw.img {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:01 devstack sudo[87095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.4edf8c95-41cb-4460-8dcc-751d9f28b197c5a7odyw.img Apr 21 02:07:01 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:02 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.4edf8c95-41cb-4460-8dcc-751d9f28b197c5a7odyw.img" returned: 1 in 0.530s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.4edf8c95-41cb-4460-8dcc-751d9f28b197c5a7odyw.img' failed. Not Retrying. {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 02:07:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.4edf8c95-41cb-4460-8dcc-751d9f28b197c5a7odyw.img /opt/stack/data/cinder/conversion/vol_upload_99xdgqhi {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:02 devstack sudo[87100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.4edf8c95-41cb-4460-8dcc-751d9f28b197c5a7odyw.img /opt/stack/data/cinder/conversion/vol_upload_99xdgqhi Apr 21 02:07:02 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:02 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.4edf8c95-41cb-4460-8dcc-751d9f28b197c5a7odyw.img /opt/stack/data/cinder/conversion/vol_upload_99xdgqhi" returned: 0 in 0.502s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:02 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] Image conversion details: src /opt/stack/data/cinder/conversion/273da430-61af-4702-ba70-1dfed29fcc52.temp_image.4edf8c95-41cb-4460-8dcc-751d9f28b197c5a7odyw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_99xdgqhi {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:07:02 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 21 02:07:02 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e6f408-0c7b-4508-97c8-c88c23d3e191]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_99xdgqhi {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:02 devstack sudo[87105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_99xdgqhi Apr 21 02:07:02 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:03 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_99xdgqhi" returned: 0 in 0.502s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.640s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] Uploaded volume to glance image-id: 4edf8c95-41cb-4460-8dcc-751d9f28b197. {{(pid=82184) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 21 02:07:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.788s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1251302349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be27d72e-dd33-4a0b-b010-4262078fbf21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e35caae10724598a98aa320fde9f0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:00Z,use_quota=True,user_id='5696ada496764f9c902070c5eecd4fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:07:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Creating volume be27d72e-dd33-4a0b-b010-4262078fbf21 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:07:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:07:03 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:07:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:04 devstack sudo[87110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21 1073741824 Apr 21 02:07:04 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:04 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-f555d2b3-edfe-492a-9797-a3c054eb1e3c tempest-VolumesActionsTest-1192287018 None] Copy volume to image completed successfully. Apr 21 02:07:04 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21 1073741824" returned: 0 in 0.512s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:04 devstack sudo[87115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21 Apr 21 02:07:04 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:04 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21" returned: 0 in 0.406s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:07:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f0158b-d870-423f-8d3c-9f8eb3f372c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be27d72e-dd33-4a0b-b010-4262078fbf21', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14aa406a-2f65-462c-8b71-449d23fbdb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:04 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Volume volume-be27d72e-dd33-4a0b-b010-4262078fbf21 (be27d72e-dd33-4a0b-b010-4262078fbf21): created successfully Apr 21 02:07:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14aa406a-2f65-462c-8b71-449d23fbdb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Flow 'volume_create_manager' (6c30d443-b043-4104-84e0-f21d661d56c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:04 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-3f55312a-d3df-4b06-b62b-50a28374e81b tempest-VolumesExtendTest-270199420 None] Created volume successfully. Apr 21 02:07:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] Acquiring lock "cinder-273da430-61af-4702-ba70-1dfed29fcc52-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] Lock "cinder-273da430-61af-4702-ba70-1dfed29fcc52-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] Acquiring lock "cinder-quobyte-273da430-61af-4702-ba70-1dfed29fcc52" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] Lock "cinder-quobyte-273da430-61af-4702-ba70-1dfed29fcc52" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:05 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c983252-0142-4ac1-a4a9-99adb825357d]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] Creating offline snapshot 3d29165a-5704-4eda-8810-7f6746ad2ba4 of volume be27d72e-dd33-4a0b-b010-4262078fbf21 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:07:05 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3278f1d-88c7-4bae-8140-3f01a44e7e4d]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:05 devstack sudo[87119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 Apr 21 02:07:05 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:05 devstack sudo[87120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21 Apr 21 02:07:05 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:06 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52" returned: 0 in 0.582s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:06 devstack sudo[87129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52 Apr 21 02:07:06 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:06 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21" returned: 0 in 0.611s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:06 devstack sudo[87131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4 1G Apr 21 02:07:06 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:06 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-273da430-61af-4702-ba70-1dfed29fcc52" returned: 0 in 0.519s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:06 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] Lock "cinder-quobyte-273da430-61af-4702-ba70-1dfed29fcc52" released by "delete_volume" :: held 1.139s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:06 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] Created reservations ['a41c64a3-70e0-49e3-91bb-65284e9d9c06', 'ae43e36d-d43f-48cf-8809-7f2548213d26', '02654e35-6401-40df-af86-9507426ad860', '00ed2285-296d-4fc3-8d74-e8ff3711da6a'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:07:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:06 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:07:06 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:06 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4 1G" returned: 0 in 0.626s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be27d72e-dd33-4a0b-b010-4262078fbf21 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:06 devstack sudo[87141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be27d72e-dd33-4a0b-b010-4262078fbf21 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4 Apr 21 02:07:06 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:07 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.414s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:07 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:07:07 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] Deleted volume successfully. Apr 21 02:07:07 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8a10d455-514f-4a36-a826-55c46ec757de tempest-VolumesActionsTest-1192287018 None] Lock "cinder-273da430-61af-4702-ba70-1dfed29fcc52-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:07 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be27d72e-dd33-4a0b-b010-4262078fbf21 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4" returned: 0 in 0.448s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:07 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4 is being set with open permissions: ugo+rw Apr 21 02:07:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:07 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4 Apr 21 02:07:07 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:07 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4" returned: 0 in 0.430s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:07 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.info Apr 21 02:07:07 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:08 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.info" returned: 0 in 0.456s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:08 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.info is being set with open permissions: ugo+rw Apr 21 02:07:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:08 devstack sudo[87168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.info Apr 21 02:07:08 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:08 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.info" returned: 0 in 0.453s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.104s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:08 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-6c951d60-0459-45c6-b69c-5e9587c30abf tempest-VolumesExtendTest-270199420 None] Create snapshot completed successfully Apr 21 02:07:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fcdbf1c3-b255-4e5a-8b79-3281e4766f1f tempest-VolumesExtendTest-270199420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fcdbf1c3-b255-4e5a-8b79-3281e4766f1f tempest-VolumesExtendTest-270199420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:09 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c77948-ee31-4f9c-bf90-7bed0dd71396]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fcdbf1c3-b255-4e5a-8b79-3281e4766f1f tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:09 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21 Apr 21 02:07:09 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:10 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fcdbf1c3-b255-4e5a-8b79-3281e4766f1f tempest-VolumesExtendTest-270199420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21" returned: 0 in 0.558s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fcdbf1c3-b255-4e5a-8b79-3281e4766f1f tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4 2G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fcdbf1c3-b255-4e5a-8b79-3281e4766f1f tempest-VolumesExtendTest-270199420 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4 2G" returned: 0 in 0.081s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fcdbf1c3-b255-4e5a-8b79-3281e4766f1f tempest-VolumesExtendTest-270199420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.656s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:10 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:UPDATE=140,cinder:SELECT=110,cinder:INSERT=31,cinder:DELETE=9 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:07:10 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:SELECT=108,cinder:INSERT=43,cinder:UPDATE=117,cinder:DELETE=12 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:07:10 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-fcdbf1c3-b255-4e5a-8b79-3281e4766f1f tempest-VolumesExtendTest-270199420 None] Extend volume completed successfully. Apr 21 02:07:10 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] Acquiring lock "cinder-3d29165a-5704-4eda-8810-7f6746ad2ba4-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:10 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] Lock "cinder-3d29165a-5704-4eda-8810-7f6746ad2ba4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:10 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] Acquiring lock "cinder-quobyte-be27d72e-dd33-4a0b-b010-4262078fbf21" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:10 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] Lock "cinder-quobyte-be27d72e-dd33-4a0b-b010-4262078fbf21" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:10 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] Acquiring lock "cinder-quobyte-3d29165a-5704-4eda-8810-7f6746ad2ba4" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:10 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] Lock "cinder-quobyte-3d29165a-5704-4eda-8810-7f6746ad2ba4" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:10 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] Deleting offline snapshot 3d29165a-5704-4eda-8810-7f6746ad2ba4 of volume be27d72e-dd33-4a0b-b010-4262078fbf21 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] snapshot_file for this snap is: volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff096d0b-7aeb-42a5-8c9a-9a1186e4cf13]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:11 devstack sudo[87184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4 Apr 21 02:07:11 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Flow 'volume_create_manager' (feb1c72d-b98b-4f99-9aed-de8f7dfe2128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022ea6b1-e210-424d-9ff7-5f1322261e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022ea6b1-e210-424d-9ff7-5f1322261e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1835580628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2f3923-ab96-44b1-a4f2-27e83e7e960a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05687c7c0120458b83a4cb31b2fc133a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:12Z,use_quota=True,user_id='b3b303eaf47d47a49f302ebbd542bcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583154d0-7495-44a2-8439-5473bd1c93cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583154d0-7495-44a2-8439-5473bd1c93cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4e23e9-f874-448a-a85d-1d2968d43ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4e23e9-f874-448a-a85d-1d2968d43ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a2f3923-ab96-44b1-a4f2-27e83e7e960a', 'volume_name': 'volume-2a2f3923-ab96-44b1-a4f2-27e83e7e960a', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:11 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e1c060-67dc-4d08-83cc-f7f87ece4f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e1c060-67dc-4d08-83cc-f7f87ece4f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95baa08b-a57d-4397-a740-db01a4c8164f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:11 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Volume 2a2f3923-ab96-44b1-a4f2-27e83e7e960a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a2f3923-ab96-44b1-a4f2-27e83e7e960a', 'volume_size': 1} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1835580628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2f3923-ab96-44b1-a4f2-27e83e7e960a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05687c7c0120458b83a4cb31b2fc133a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:12Z,use_quota=True,user_id='b3b303eaf47d47a49f302ebbd542bcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Creating volume 2a2f3923-ab96-44b1-a4f2-27e83e7e960a {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:07:11 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a2f3923-ab96-44b1-a4f2-27e83e7e960a 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4" returned: 0 in 0.752s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be27d72e-dd33-4a0b-b010-4262078fbf21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:07:11 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a2f3923-ab96-44b1-a4f2-27e83e7e960a 1073741824 Apr 21 02:07:11 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[009c0273-1a7b-48e5-a3f6-b6aecd41034d]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:11 devstack sudo[87217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21 Apr 21 02:07:11 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:12 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a2f3923-ab96-44b1-a4f2-27e83e7e960a 1073741824" returned: 0 in 0.595s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:12 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21" returned: 0 in 0.564s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a2f3923-ab96-44b1-a4f2-27e83e7e960a {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:12 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4 Apr 21 02:07:12 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:12 devstack sudo[87231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a2f3923-ab96-44b1-a4f2-27e83e7e960a Apr 21 02:07:12 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:12 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a2f3923-ab96-44b1-a4f2-27e83e7e960a" returned: 0 in 0.487s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:12 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:07:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:12 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95baa08b-a57d-4397-a740-db01a4c8164f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a2f3923-ab96-44b1-a4f2-27e83e7e960a', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:12 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986e1fc8-c658-456e-8cc8-15aab903da4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:12 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Volume volume-2a2f3923-ab96-44b1-a4f2-27e83e7e960a (2a2f3923-ab96-44b1-a4f2-27e83e7e960a): created successfully Apr 21 02:07:12 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986e1fc8-c658-456e-8cc8-15aab903da4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:12 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Flow 'volume_create_manager' (feb1c72d-b98b-4f99-9aed-de8f7dfe2128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:12 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-8232ddbf-4d3f-434c-9c78-b61a90d72a9f tempest-VolumesListTestJSON-159258667 None] Created volume successfully. Apr 21 02:07:12 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4" returned: 0 in 0.622s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:13 devstack sudo[87237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4 Apr 21 02:07:13 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:13 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21.3d29165a-5704-4eda-8810-7f6746ad2ba4" returned: 0 in 0.409s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:13 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] Lock "cinder-quobyte-3d29165a-5704-4eda-8810-7f6746ad2ba4" released by "_delete_snapshot" :: held 2.435s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:13 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] Lock "cinder-quobyte-be27d72e-dd33-4a0b-b010-4262078fbf21" released by "delete_snapshot" :: held 2.452s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:13 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] Created reservations ['565723b2-a1c0-4170-b5b4-b037bbc4b1a3', '7c77d161-fde8-4c7a-96ce-a6fc67c64e81', '6ffbb0da-b5a0-4e95-9eaa-4348c09ba90f', 'b8ea34ae-6139-4172-a399-e14992855c20'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:07:13 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] Delete snapshot completed successfully. Apr 21 02:07:13 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2361560b-8178-40fd-8a8c-f8d3aef5f370 tempest-VolumesExtendTest-270199420 None] Lock "cinder-3d29165a-5704-4eda-8810-7f6746ad2ba4-delete_snapshot" released by "delete_snapshot" :: held 2.550s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Flow 'volume_create_manager' (30df2e2c-0d70-4157-8acb-b2ed89d82620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b2d5e6-b62f-4638-b1fa-b1ce2073709f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b2d5e6-b62f-4638-b1fa-b1ce2073709f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1152719866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005e9e17-d8b2-44d9-bb22-2920d91291fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05687c7c0120458b83a4cb31b2fc133a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:14Z,use_quota=True,user_id='b3b303eaf47d47a49f302ebbd542bcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6760b102-7f0b-42f6-870a-c6f2f690b4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6760b102-7f0b-42f6-870a-c6f2f690b4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f873ce1b-a3f7-425e-b277-64dadd2761f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f873ce1b-a3f7-425e-b277-64dadd2761f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '005e9e17-d8b2-44d9-bb22-2920d91291fd', 'volume_name': 'volume-005e9e17-d8b2-44d9-bb22-2920d91291fd', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7208a385-4daf-48bf-8a1e-6333464550ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7208a385-4daf-48bf-8a1e-6333464550ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed67fed-286e-42dc-aa4d-e2913bd31764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:14 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Volume 005e9e17-d8b2-44d9-bb22-2920d91291fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-005e9e17-d8b2-44d9-bb22-2920d91291fd', 'volume_size': 1} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1152719866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005e9e17-d8b2-44d9-bb22-2920d91291fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05687c7c0120458b83a4cb31b2fc133a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:14Z,use_quota=True,user_id='b3b303eaf47d47a49f302ebbd542bcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Creating volume 005e9e17-d8b2-44d9-bb22-2920d91291fd {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:07:14 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-005e9e17-d8b2-44d9-bb22-2920d91291fd 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:14 devstack sudo[87240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-005e9e17-d8b2-44d9-bb22-2920d91291fd 1073741824 Apr 21 02:07:14 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] Acquiring lock "cinder-be27d72e-dd33-4a0b-b010-4262078fbf21-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] Lock "cinder-be27d72e-dd33-4a0b-b010-4262078fbf21-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] Acquiring lock "cinder-quobyte-be27d72e-dd33-4a0b-b010-4262078fbf21" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] Lock "cinder-quobyte-be27d72e-dd33-4a0b-b010-4262078fbf21" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5654a94-1c59-4f3a-b788-70c6b1095d79]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:14 devstack sudo[87242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21 Apr 21 02:07:14 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:14 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-005e9e17-d8b2-44d9-bb22-2920d91291fd 1073741824" returned: 0 in 0.644s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-005e9e17-d8b2-44d9-bb22-2920d91291fd {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:14 devstack sudo[87253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-005e9e17-d8b2-44d9-bb22-2920d91291fd Apr 21 02:07:14 devstack sudo[87253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:14 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21" returned: 0 in 0.629s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:14 devstack sudo[87255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21 Apr 21 02:07:14 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:15 devstack sudo[87253]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-005e9e17-d8b2-44d9-bb22-2920d91291fd" returned: 0 in 0.466s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed67fed-286e-42dc-aa4d-e2913bd31764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-005e9e17-d8b2-44d9-bb22-2920d91291fd', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170bdc11-8737-48c4-b800-9976f46dabf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:15 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Volume volume-005e9e17-d8b2-44d9-bb22-2920d91291fd (005e9e17-d8b2-44d9-bb22-2920d91291fd): created successfully Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170bdc11-8737-48c4-b800-9976f46dabf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Flow 'volume_create_manager' (30df2e2c-0d70-4157-8acb-b2ed89d82620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:15 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-7ee9c8bf-2812-4733-ad6b-0d8cf1cca7c1 tempest-VolumesListTestJSON-159258667 None] Created volume successfully. Apr 21 02:07:15 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-be27d72e-dd33-4a0b-b010-4262078fbf21" returned: 0 in 0.499s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] Lock "cinder-quobyte-be27d72e-dd33-4a0b-b010-4262078fbf21" released by "delete_volume" :: held 1.167s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] Created reservations ['9257e7fd-c3f1-4ca1-b038-6dcc5532cce4', '58efb3eb-4806-436e-9be7-f67a3d4341a8', '136f8e43-8114-4fc4-a5c5-e423562aab5f', '0207477f-457d-48d1-a65c-454cb5975afc'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:15 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:07:15 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:15 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.405s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:07:15 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] Deleted volume successfully. Apr 21 02:07:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fca976d6-1fa0-475f-b68b-f8c40d01eaf2 tempest-VolumesExtendTest-270199420 None] Lock "cinder-be27d72e-dd33-4a0b-b010-4262078fbf21-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Flow 'volume_create_manager' (38326169-947b-4bdf-8f78-905ca1b14497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139eb738-63ba-4e17-9190-e2b133066fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139eb738-63ba-4e17-9190-e2b133066fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-9071505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3853cee-5f61-48c2-9421-5e01ad25e317,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05687c7c0120458b83a4cb31b2fc133a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:16Z,use_quota=True,user_id='b3b303eaf47d47a49f302ebbd542bcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d743f5d4-f6b1-4503-864b-f3b227280a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d743f5d4-f6b1-4503-864b-f3b227280a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d2ea969-da23-4453-9e3b-e6a3b00aa856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d2ea969-da23-4453-9e3b-e6a3b00aa856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3853cee-5f61-48c2-9421-5e01ad25e317', 'volume_name': 'volume-b3853cee-5f61-48c2-9421-5e01ad25e317', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e507676c-c4c8-4f2a-a342-07ff0215a4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e507676c-c4c8-4f2a-a342-07ff0215a4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8813d7b-fe94-43cd-8dd1-cbd6dee39936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:16 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Volume b3853cee-5f61-48c2-9421-5e01ad25e317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3853cee-5f61-48c2-9421-5e01ad25e317', 'volume_size': 1} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-9071505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3853cee-5f61-48c2-9421-5e01ad25e317,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05687c7c0120458b83a4cb31b2fc133a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:16Z,use_quota=True,user_id='b3b303eaf47d47a49f302ebbd542bcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Creating volume b3853cee-5f61-48c2-9421-5e01ad25e317 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:07:16 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:07:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b3853cee-5f61-48c2-9421-5e01ad25e317 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:16 devstack sudo[87264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b3853cee-5f61-48c2-9421-5e01ad25e317 1073741824 Apr 21 02:07:16 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:17 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b3853cee-5f61-48c2-9421-5e01ad25e317 1073741824" returned: 0 in 0.575s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b3853cee-5f61-48c2-9421-5e01ad25e317 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:17 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b3853cee-5f61-48c2-9421-5e01ad25e317 Apr 21 02:07:17 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:17 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b3853cee-5f61-48c2-9421-5e01ad25e317" returned: 0 in 0.497s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:07:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8813d7b-fe94-43cd-8dd1-cbd6dee39936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3853cee-5f61-48c2-9421-5e01ad25e317', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97680a7-514d-40e1-a5ee-e216bed73db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:17 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Volume volume-b3853cee-5f61-48c2-9421-5e01ad25e317 (b3853cee-5f61-48c2-9421-5e01ad25e317): created successfully Apr 21 02:07:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97680a7-514d-40e1-a5ee-e216bed73db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Flow 'volume_create_manager' (38326169-947b-4bdf-8f78-905ca1b14497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:17 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b214dc4e-0092-4899-8296-234a4fd630cd tempest-VolumesListTestJSON-159258667 None] Created volume successfully. Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Flow 'volume_create_manager' (9fc1347b-1932-4b12-b920-7a08a61b5b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c4d04f-cda3-4b01-b49f-13a5e98bf361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c4d04f-cda3-4b01-b49f-13a5e98bf361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1949598588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f146495c-2993-4a0b-82d6-1b0a7836af3c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='73f7efcfd60346dc9f726bdec75a13ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:18Z,use_quota=True,user_id='dd644e2eb1a94ccfa58ea69861b85983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634bcb92-b0d1-4b54-8a19-fcdf88698f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634bcb92-b0d1-4b54-8a19-fcdf88698f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30d86b2-fdd7-4213-aa87-dad816be5856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30d86b2-fdd7-4213-aa87-dad816be5856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f146495c-2993-4a0b-82d6-1b0a7836af3c', 'volume_name': 'volume-f146495c-2993-4a0b-82d6-1b0a7836af3c', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e209b0-f874-4580-a5b4-1a313fa8ca47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e209b0-f874-4580-a5b4-1a313fa8ca47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e0909b-6a64-4041-945c-08cbd79ad0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:18 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Volume f146495c-2993-4a0b-82d6-1b0a7836af3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f146495c-2993-4a0b-82d6-1b0a7836af3c', 'volume_size': 1} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1949598588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f146495c-2993-4a0b-82d6-1b0a7836af3c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='73f7efcfd60346dc9f726bdec75a13ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:18Z,use_quota=True,user_id='dd644e2eb1a94ccfa58ea69861b85983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Creating volume f146495c-2993-4a0b-82d6-1b0a7836af3c {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:07:18 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:07:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f146495c-2993-4a0b-82d6-1b0a7836af3c 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:18 devstack sudo[87272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f146495c-2993-4a0b-82d6-1b0a7836af3c 1073741824 Apr 21 02:07:18 devstack sudo[87272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:19 devstack sudo[87272]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f146495c-2993-4a0b-82d6-1b0a7836af3c 1073741824" returned: 0 in 0.640s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f146495c-2993-4a0b-82d6-1b0a7836af3c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:19 devstack sudo[87277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f146495c-2993-4a0b-82d6-1b0a7836af3c Apr 21 02:07:19 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:19 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f146495c-2993-4a0b-82d6-1b0a7836af3c" returned: 0 in 0.574s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:19 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:07:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:19 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e0909b-6a64-4041-945c-08cbd79ad0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f146495c-2993-4a0b-82d6-1b0a7836af3c', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:19 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc68a7c-f4e1-4554-a453-b9e5ac02bd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:19 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Volume volume-f146495c-2993-4a0b-82d6-1b0a7836af3c (f146495c-2993-4a0b-82d6-1b0a7836af3c): created successfully Apr 21 02:07:19 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc68a7c-f4e1-4554-a453-b9e5ac02bd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:19 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Flow 'volume_create_manager' (9fc1347b-1932-4b12-b920-7a08a61b5b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:19 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-c2a2d37e-e62a-45c1-8ad9-bbba814bf5c4 tempest-VolumesGetTest-1570820904 None] Created volume successfully. Apr 21 02:07:20 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Flow 'volume_create_manager' (f06c3756-0259-474f-beed-ad32231d2bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac32ab1-ef13-4634-8073-8cd52ffc136d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac32ab1-ef13-4634-8073-8cd52ffc136d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-370766216',display_name='tempest-VolumesGetTest-Volume-335983197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=517dcf69-2453-4a19-ab64-e671171a244f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f7efcfd60346dc9f726bdec75a13ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:21Z,use_quota=True,user_id='dd644e2eb1a94ccfa58ea69861b85983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4216cff-f779-408b-9a88-b6925f717828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4216cff-f779-408b-9a88-b6925f717828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4c895e-2bef-41f7-b7b5-5a8a207f914f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4c895e-2bef-41f7-b7b5-5a8a207f914f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '517dcf69-2453-4a19-ab64-e671171a244f', 'volume_name': 'volume-517dcf69-2453-4a19-ab64-e671171a244f', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af85476-160a-43c4-8266-e80fbd051920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af85476-160a-43c4-8266-e80fbd051920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bf749a-bc10-4c5d-8676-537690f02ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:21 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Volume 517dcf69-2453-4a19-ab64-e671171a244f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-517dcf69-2453-4a19-ab64-e671171a244f', 'volume_size': 1} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-370766216',display_name='tempest-VolumesGetTest-Volume-335983197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=517dcf69-2453-4a19-ab64-e671171a244f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f7efcfd60346dc9f726bdec75a13ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:21Z,use_quota=True,user_id='dd644e2eb1a94ccfa58ea69861b85983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Creating volume 517dcf69-2453-4a19-ab64-e671171a244f {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:07:21 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-517dcf69-2453-4a19-ab64-e671171a244f 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] Acquiring lock "cinder-b3853cee-5f61-48c2-9421-5e01ad25e317-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:21 devstack sudo[87285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-517dcf69-2453-4a19-ab64-e671171a244f 1073741824 Apr 21 02:07:21 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] Lock "cinder-b3853cee-5f61-48c2-9421-5e01ad25e317-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] Acquiring lock "cinder-quobyte-b3853cee-5f61-48c2-9421-5e01ad25e317" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] Lock "cinder-quobyte-b3853cee-5f61-48c2-9421-5e01ad25e317" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[851e7eac-44d8-4a0f-84ad-4f51407e3be1]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b3853cee-5f61-48c2-9421-5e01ad25e317 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:21 devstack sudo[87290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b3853cee-5f61-48c2-9421-5e01ad25e317 Apr 21 02:07:21 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:21 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-517dcf69-2453-4a19-ab64-e671171a244f 1073741824" returned: 0 in 0.735s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-517dcf69-2453-4a19-ab64-e671171a244f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:21 devstack sudo[87313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-517dcf69-2453-4a19-ab64-e671171a244f Apr 21 02:07:21 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:21 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b3853cee-5f61-48c2-9421-5e01ad25e317" returned: 0 in 0.666s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b3853cee-5f61-48c2-9421-5e01ad25e317 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:21 devstack sudo[87315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b3853cee-5f61-48c2-9421-5e01ad25e317 Apr 21 02:07:21 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:22 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-517dcf69-2453-4a19-ab64-e671171a244f" returned: 0 in 0.491s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bf749a-bc10-4c5d-8676-537690f02ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-517dcf69-2453-4a19-ab64-e671171a244f', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63fba9d-9941-4800-8b99-0024bd91d7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:22 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b3853cee-5f61-48c2-9421-5e01ad25e317" returned: 0 in 0.485s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:22 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Volume volume-517dcf69-2453-4a19-ab64-e671171a244f (517dcf69-2453-4a19-ab64-e671171a244f): created successfully Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63fba9d-9941-4800-8b99-0024bd91d7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Flow 'volume_create_manager' (f06c3756-0259-474f-beed-ad32231d2bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] Lock "cinder-quobyte-b3853cee-5f61-48c2-9421-5e01ad25e317" released by "delete_volume" :: held 1.199s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:22 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-d77fcdfa-ee90-4f87-b035-c1db5319a45a tempest-VolumesGetTest-1570820904 None] Created volume successfully. Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] Created reservations ['4f868438-2804-49e0-8821-5696c402603d', '8865f3d3-1b14-4ede-8539-3e970e1753d2', 'c49fa1f3-f645-4473-8cf3-53d0a5138446', '8e455025-cf88-4f19-8c1d-e07702966d68'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:22 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:07:22 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:22 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.468s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:07:22 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] Deleted volume successfully. Apr 21 02:07:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f22d5250-f2a5-48fb-bf28-c0d8e29be1ef tempest-VolumesListTestJSON-159258667 None] Lock "cinder-b3853cee-5f61-48c2-9421-5e01ad25e317-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] Acquiring lock "cinder-517dcf69-2453-4a19-ab64-e671171a244f-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] Lock "cinder-517dcf69-2453-4a19-ab64-e671171a244f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] Acquiring lock "cinder-quobyte-517dcf69-2453-4a19-ab64-e671171a244f" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] Lock "cinder-quobyte-517dcf69-2453-4a19-ab64-e671171a244f" acquired by "delete_volume" :: waited 0.006s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:23 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b070d89-375a-4f71-89e9-b9fd38b5d3e1]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-517dcf69-2453-4a19-ab64-e671171a244f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] Acquiring lock "cinder-005e9e17-d8b2-44d9-bb22-2920d91291fd-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] Lock "cinder-005e9e17-d8b2-44d9-bb22-2920d91291fd-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:23 devstack sudo[87325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-517dcf69-2453-4a19-ab64-e671171a244f Apr 21 02:07:23 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] Acquiring lock "cinder-quobyte-005e9e17-d8b2-44d9-bb22-2920d91291fd" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] Lock "cinder-quobyte-005e9e17-d8b2-44d9-bb22-2920d91291fd" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:23 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25cf6b6-5a16-4aa1-9cbd-3035ab49afc0]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-005e9e17-d8b2-44d9-bb22-2920d91291fd {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:23 devstack sudo[87327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-005e9e17-d8b2-44d9-bb22-2920d91291fd Apr 21 02:07:23 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:23 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-517dcf69-2453-4a19-ab64-e671171a244f" returned: 0 in 0.624s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-517dcf69-2453-4a19-ab64-e671171a244f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:23 devstack sudo[87335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-517dcf69-2453-4a19-ab64-e671171a244f Apr 21 02:07:23 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:23 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-005e9e17-d8b2-44d9-bb22-2920d91291fd" returned: 0 in 0.523s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-005e9e17-d8b2-44d9-bb22-2920d91291fd {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:23 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-005e9e17-d8b2-44d9-bb22-2920d91291fd Apr 21 02:07:23 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:24 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-517dcf69-2453-4a19-ab64-e671171a244f" returned: 0 in 0.471s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:24 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] Lock "cinder-quobyte-517dcf69-2453-4a19-ab64-e671171a244f" released by "delete_volume" :: held 1.122s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:24 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-005e9e17-d8b2-44d9-bb22-2920d91291fd" returned: 0 in 0.440s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:24 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] Lock "cinder-quobyte-005e9e17-d8b2-44d9-bb22-2920d91291fd" released by "delete_volume" :: held 1.008s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:24 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] Created reservations ['88c18ee4-5ffb-4557-b9d2-d66484a841c3', '0e7139c9-314f-4dff-8a26-19df42618c48', '81e52a15-35bd-4be9-806b-6dc34e73563b', '7e93b5bd-8d64-4919-85cc-6120d8b46b84'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:07:24 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] Created reservations ['382dbd70-e2de-48d4-afe0-93858ba7962b', 'b360d2e9-a3a2-4a3a-bf3b-b35207984ce9', 'e184626c-6194-49b5-8497-7fe66846b293', '21e3f4dd-6e7d-445b-9d06-84f361191d1e'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:07:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:24 devstack sudo[87341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:07:24 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:24 devstack sudo[87343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:07:24 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:25 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.633s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:25 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:07:25 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] Deleted volume successfully. Apr 21 02:07:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5ad98ed3-65c5-4d5d-b050-1593dc1f4500 tempest-VolumesListTestJSON-159258667 None] Lock "cinder-005e9e17-d8b2-44d9-bb22-2920d91291fd-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:25 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.894s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:25 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:07:25 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] Deleted volume successfully. Apr 21 02:07:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f31803a5-b300-4a5e-9382-c9e13162a63d tempest-VolumesGetTest-1570820904 None] Lock "cinder-517dcf69-2453-4a19-ab64-e671171a244f-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] Acquiring lock "cinder-f146495c-2993-4a0b-82d6-1b0a7836af3c-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] Lock "cinder-f146495c-2993-4a0b-82d6-1b0a7836af3c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] Acquiring lock "cinder-quobyte-f146495c-2993-4a0b-82d6-1b0a7836af3c" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] Lock "cinder-quobyte-f146495c-2993-4a0b-82d6-1b0a7836af3c" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:25 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce36dd1-510f-46c3-969b-e798903a4dcb]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f146495c-2993-4a0b-82d6-1b0a7836af3c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] Acquiring lock "cinder-2a2f3923-ab96-44b1-a4f2-27e83e7e960a-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] Lock "cinder-2a2f3923-ab96-44b1-a4f2-27e83e7e960a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:25 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f146495c-2993-4a0b-82d6-1b0a7836af3c Apr 21 02:07:25 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] Acquiring lock "cinder-quobyte-2a2f3923-ab96-44b1-a4f2-27e83e7e960a" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] Lock "cinder-quobyte-2a2f3923-ab96-44b1-a4f2-27e83e7e960a" acquired by "delete_volume" :: waited 0.024s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:25 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[297b3b32-d1aa-4af5-aa1d-52a875a5f4ab]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a2f3923-ab96-44b1-a4f2-27e83e7e960a {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:25 devstack sudo[87378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a2f3923-ab96-44b1-a4f2-27e83e7e960a Apr 21 02:07:25 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:26 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f146495c-2993-4a0b-82d6-1b0a7836af3c" returned: 0 in 0.583s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f146495c-2993-4a0b-82d6-1b0a7836af3c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:26 devstack sudo[87383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f146495c-2993-4a0b-82d6-1b0a7836af3c Apr 21 02:07:26 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:26 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a2f3923-ab96-44b1-a4f2-27e83e7e960a" returned: 0 in 0.608s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a2f3923-ab96-44b1-a4f2-27e83e7e960a {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:26 devstack sudo[87388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a2f3923-ab96-44b1-a4f2-27e83e7e960a Apr 21 02:07:26 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:26 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f146495c-2993-4a0b-82d6-1b0a7836af3c" returned: 0 in 0.670s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:26 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] Lock "cinder-quobyte-f146495c-2993-4a0b-82d6-1b0a7836af3c" released by "delete_volume" :: held 1.310s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:26 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] Created reservations ['0e994106-4905-4fc3-a0c7-b5792c5197e7', 'fecc59fd-8a22-45ed-a277-f589f3c6ff88', '3deffca5-4e38-406b-bf47-85f05aaff8a7', 'fdd51d2b-f965-42a0-8084-a1bb49a5a840'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:07:26 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2a2f3923-ab96-44b1-a4f2-27e83e7e960a" returned: 0 in 0.583s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] Lock "cinder-quobyte-2a2f3923-ab96-44b1-a4f2-27e83e7e960a" released by "delete_volume" :: held 1.249s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:27 devstack sudo[87392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:07:27 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] Created reservations ['57425863-0375-49d3-86c0-9da7be013606', 'ba2589f9-586f-4d98-8211-fc8be0d39ded', '702eccba-bc59-4cee-9a72-50d09f7df0db', '6468cce6-5bef-48a3-8a07-ad744406abe4'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:27 devstack sudo[87394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:07:27 devstack sudo[87394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:27 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.436s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:07:27 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] Deleted volume successfully. Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-66903d6a-91e6-4cef-8712-84e1589b816f tempest-VolumesGetTest-1570820904 None] Lock "cinder-f146495c-2993-4a0b-82d6-1b0a7836af3c-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:27 devstack sudo[87394]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.486s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:07:27 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] Deleted volume successfully. Apr 21 02:07:27 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c6b8a367-ea50-4871-98d9-56dff3500543 tempest-VolumesListTestJSON-159258667 None] Lock "cinder-2a2f3923-ab96-44b1-a4f2-27e83e7e960a-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Flow 'volume_create_manager' (2b5ab2ce-ed80-4fc0-8dc0-145119d3da61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce58af5-d60b-4957-9b8d-9aeb67a69f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce58af5-d60b-4957-9b8d-9aeb67a69f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-384613515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a5939d-ea4a-4585-a658-5855c7b87dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f7efcfd60346dc9f726bdec75a13ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:28Z,use_quota=True,user_id='dd644e2eb1a94ccfa58ea69861b85983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ce36fe-4360-4851-a7d4-2a8a6d8d73ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ce36fe-4360-4851-a7d4-2a8a6d8d73ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (552efabb-7a35-4264-9fc4-a8f97c089c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (552efabb-7a35-4264-9fc4-a8f97c089c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9a5939d-ea4a-4585-a658-5855c7b87dbf', 'volume_name': 'volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (973f5db8-1286-4589-9d79-f604b23c77ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (973f5db8-1286-4589-9d79-f604b23c77ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00797692-c278-42af-9596-9172a5aba2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:28 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Volume c9a5939d-ea4a-4585-a658-5855c7b87dbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf', 'volume_size': 1} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-384613515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a5939d-ea4a-4585-a658-5855c7b87dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f7efcfd60346dc9f726bdec75a13ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:28Z,use_quota=True,user_id='dd644e2eb1a94ccfa58ea69861b85983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Creating volume c9a5939d-ea4a-4585-a658-5855c7b87dbf {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:07:28 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:28 devstack sudo[87399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf 1073741824 Apr 21 02:07:28 devstack sudo[87399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:28 devstack sudo[87399]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf 1073741824" returned: 0 in 0.729s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:29 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf Apr 21 02:07:29 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:29 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf" returned: 0 in 0.637s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:29 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:07:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:29 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00797692-c278-42af-9596-9172a5aba2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:29 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85b7c5b-ff02-427d-be3f-882d9103ea8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:29 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Volume volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf (c9a5939d-ea4a-4585-a658-5855c7b87dbf): created successfully Apr 21 02:07:29 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85b7c5b-ff02-427d-be3f-882d9103ea8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:29 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Flow 'volume_create_manager' (2b5ab2ce-ed80-4fc0-8dc0-145119d3da61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:29 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-e0a638df-99ad-4e77-b6de-54b49385cfe4 tempest-VolumesGetTest-1570820904 None] Created volume successfully. Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Flow 'volume_create_manager' (f5e4587c-68e1-4b48-b0c6-ff8bc3090249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ba79c6-ab22-4e01-9665-8b013f64e4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ba79c6-ab22-4e01-9665-8b013f64e4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1354106681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d5da26-7e44-49cb-b78c-ebc312859738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a07a3ed6c174fa0a218c446d5d9881c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:30Z,use_quota=True,user_id='dc4d1d3be2614e8c87d5a22199ae8449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4267a5-47c4-44fc-86f1-27befb95e034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4267a5-47c4-44fc-86f1-27befb95e034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be13dbd-b4d7-49f8-994e-012c01952d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be13dbd-b4d7-49f8-994e-012c01952d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84d5da26-7e44-49cb-b78c-ebc312859738', 'volume_name': 'volume-84d5da26-7e44-49cb-b78c-ebc312859738', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53db0766-daae-498c-b805-1181d18f4a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53db0766-daae-498c-b805-1181d18f4a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b5bd59-bb75-4176-86d7-3c87ee275309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:30 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Volume 84d5da26-7e44-49cb-b78c-ebc312859738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84d5da26-7e44-49cb-b78c-ebc312859738', 'volume_size': 1} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1354106681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d5da26-7e44-49cb-b78c-ebc312859738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a07a3ed6c174fa0a218c446d5d9881c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:30Z,use_quota=True,user_id='dc4d1d3be2614e8c87d5a22199ae8449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Creating volume 84d5da26-7e44-49cb-b78c-ebc312859738 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:07:30 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-84d5da26-7e44-49cb-b78c-ebc312859738 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:30 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-84d5da26-7e44-49cb-b78c-ebc312859738 1073741824 Apr 21 02:07:30 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Flow 'volume_create_manager' (ee4cba64-120d-4e00-9e78-493300f2c80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bccce76-3087-4cb0-a9b3-5f0846e6b848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bccce76-3087-4cb0-a9b3-5f0846e6b848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1794086781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de93ecd2-6dd0-4263-90a2-4dcf31dbabe9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='73f7efcfd60346dc9f726bdec75a13ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c9a5939d-ea4a-4585-a658-5855c7b87dbf,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:31Z,use_quota=True,user_id='dd644e2eb1a94ccfa58ea69861b85983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (610eb6d5-46ce-4f21-94e1-cccc43d62e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (610eb6d5-46ce-4f21-94e1-cccc43d62e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (203d6857-451c-4e5d-8d6b-5cfd35385856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (203d6857-451c-4e5d-8d6b-5cfd35385856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'de93ecd2-6dd0-4263-90a2-4dcf31dbabe9', 'volume_name': 'volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9', 'volume_size': 1, 'source_volid': 'c9a5939d-ea4a-4585-a658-5855c7b87dbf', 'source_volstatus': 'available'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8728b90-557d-4f86-807c-60b55521f028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8728b90-557d-4f86-807c-60b55521f028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6836b8-af1e-48a8-a6cd-bacbc23b06b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:30 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Volume de93ecd2-6dd0-4263-90a2-4dcf31dbabe9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9', 'volume_size': 1, 'source_volid': 'c9a5939d-ea4a-4585-a658-5855c7b87dbf', 'source_volstatus': 'available'} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:30 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-84d5da26-7e44-49cb-b78c-ebc312859738 1073741824" returned: 0 in 0.603s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-84d5da26-7e44-49cb-b78c-ebc312859738 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:30 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-84d5da26-7e44-49cb-b78c-ebc312859738 Apr 21 02:07:30 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:31 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-84d5da26-7e44-49cb-b78c-ebc312859738" returned: 0 in 0.416s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:07:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.695s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:31 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Cloning volume c9a5939d-ea4a-4585-a658-5855c7b87dbf to volume de93ecd2-6dd0-4263-90a2-4dcf31dbabe9 Apr 21 02:07:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b5bd59-bb75-4176-86d7-3c87ee275309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84d5da26-7e44-49cb-b78c-ebc312859738', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d615784-72d9-44ae-b01c-04935490a6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:31 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Volume volume-84d5da26-7e44-49cb-b78c-ebc312859738 (84d5da26-7e44-49cb-b78c-ebc312859738): created successfully Apr 21 02:07:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d615784-72d9-44ae-b01c-04935490a6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Flow 'volume_create_manager' (f5e4587c-68e1-4b48-b0c6-ff8bc3090249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:31 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-fa1ac660-5f05-47c7-8c7f-0b4de0872ec9 tempest-VolumesNegativeTest-614563064 None] Created volume successfully. Apr 21 02:07:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Creating offline snapshot b090804c-3d56-481c-8027-f501940c01b8 of volume c9a5939d-ea4a-4585-a658-5855c7b87dbf {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:07:31 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba90bff2-adc0-410a-92d8-4ebddec19b6b]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:31 devstack sudo[87447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf Apr 21 02:07:31 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:31 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf" returned: 0 in 0.518s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:31 devstack sudo[87457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8 1G Apr 21 02:07:31 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:32 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8 1G" returned: 0 in 0.566s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:32 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8 Apr 21 02:07:32 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:33 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8" returned: 0 in 0.510s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:33 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8 is being set with open permissions: ugo+rw Apr 21 02:07:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:33 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8 Apr 21 02:07:33 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:33 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8" returned: 0 in 0.458s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:33 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.info Apr 21 02:07:33 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:33 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.info" returned: 0 in 0.451s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:33 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.info is being set with open permissions: ugo+rw Apr 21 02:07:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:33 devstack sudo[87477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.info Apr 21 02:07:33 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:34 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.info" returned: 0 in 0.524s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Acquiring lock "cinder-quobyte-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9" by "_copy_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Lock "cinder-quobyte-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] snapshot: b090804c-3d56-481c-8027-f501940c01b8, volume: de93ecd2-6dd0-4263-90a2-4dcf31dbabe9, {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[23409b80-1510-42f2-b4d6-a353277a22a1]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:07:34 devstack sudo[87480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8 Apr 21 02:07:34 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Flow 'volume_create_manager' (8d323578-42e0-46cf-8cee-79e4afbe1dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d244c21-30c9-4d7b-a378-34d779f28b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d244c21-30c9-4d7b-a378-34d779f28b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-790737931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0605c45e-4a45-4f56-a1b9-db74f85271ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4266b773afb54b31ba7b27eb206d58f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:35Z,use_quota=True,user_id='40db7e893f9942fa952ce25d4dfc73a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596dd73b-ba6f-4ed6-8751-4a4f6ab3a89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596dd73b-ba6f-4ed6-8751-4a4f6ab3a89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c212a3-aff0-4a81-83f2-172acaead9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c212a3-aff0-4a81-83f2-172acaead9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0605c45e-4a45-4f56-a1b9-db74f85271ed', 'volume_name': 'volume-0605c45e-4a45-4f56-a1b9-db74f85271ed', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b49a093-13c5-4454-80f7-fd88fafcbe3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b49a093-13c5-4454-80f7-fd88fafcbe3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dead0271-a6d6-4918-9ce1-d9f7be964774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:34 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Volume 0605c45e-4a45-4f56-a1b9-db74f85271ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0605c45e-4a45-4f56-a1b9-db74f85271ed', 'volume_size': 1} Apr 21 02:07:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:35 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8" returned: 0 in 0.545s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:07:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 02:07:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Creating direct copy from snapshot {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 02:07:35 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[43263501-e768-4f82-9973-c46c97995b16]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:35 devstack sudo[87487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf Apr 21 02:07:35 devstack sudo[87487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:35 devstack sudo[87487]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf" returned: 0 in 0.471s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:35 devstack cinder-volume[82184]: DEBUG cinder.utils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Path /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9 not found in is_blk_device check {{(pid=82184) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 02:07:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:35 devstack sudo[87492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9 Apr 21 02:07:35 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:38 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9" returned: 0 in 2.632s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:38 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5025b14d-e9f9-4d21-aa0e-690b17ff6b6a]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:38 devstack sudo[87504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf Apr 21 02:07:38 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:38 devstack cinder-volume[82184]: DEBUG oslo_service.periodic_task [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 02:07:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:38 devstack sudo[87509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:07:38 devstack sudo[87509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:38 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf" returned: 0 in 0.760s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:38 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Image conversion details: src /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf, size 1024.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9 {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:07:38 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Converted 1024.00 MB image at 388.86 MB/s Apr 21 02:07:38 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9 is being set with open permissions: ugo+rw Apr 21 02:07:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:39 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9 Apr 21 02:07:39 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:39 devstack sudo[87509]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.679s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:39 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:07:39 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9" returned: 0 in 0.585s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:39 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Lock "cinder-quobyte-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9" released by "_copy_volume_from_snapshot" :: held 5.067s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:39 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Acquiring lock "cinder-quobyte-b090804c-3d56-481c-8027-f501940c01b8" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:39 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Lock "cinder-quobyte-b090804c-3d56-481c-8027-f501940c01b8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Deleting offline snapshot b090804c-3d56-481c-8027-f501940c01b8 of volume c9a5939d-ea4a-4585-a658-5855c7b87dbf {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:07:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] snapshot_file for this snap is: volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:07:39 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a6ab0b-031a-4544-8d27-424158a6faea]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:39 devstack sudo[87529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8 Apr 21 02:07:39 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:40 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8" returned: 0 in 0.614s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:40 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:07:40 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab9e14b-627e-4d18-90de-b5e6a75bee53]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:40 devstack sudo[87537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf Apr 21 02:07:40 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:40 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf" returned: 0 in 0.475s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:40 devstack sudo[87542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8 Apr 21 02:07:40 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:41 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8" returned: 0 in 0.513s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:41 devstack sudo[87547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8 Apr 21 02:07:41 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:41 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf.b090804c-3d56-481c-8027-f501940c01b8" returned: 0 in 0.432s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Lock "cinder-quobyte-b090804c-3d56-481c-8027-f501940c01b8" released by "_delete_snapshot" :: held 2.083s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.361s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.022s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-790737931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0605c45e-4a45-4f56-a1b9-db74f85271ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4266b773afb54b31ba7b27eb206d58f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:35Z,use_quota=True,user_id='40db7e893f9942fa952ce25d4dfc73a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Creating volume 0605c45e-4a45-4f56-a1b9-db74f85271ed {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:07:41 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0605c45e-4a45-4f56-a1b9-db74f85271ed 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6836b8-af1e-48a8-a6cd-bacbc23b06b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9', 'volume_size': 1, 'source_volid': 'c9a5939d-ea4a-4585-a658-5855c7b87dbf', 'source_volstatus': 'available'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:41 devstack sudo[87550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0605c45e-4a45-4f56-a1b9-db74f85271ed 1073741824 Apr 21 02:07:41 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df9eeb8-597d-474a-9680-6e269f6cab2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:41 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Volume volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9 (de93ecd2-6dd0-4263-90a2-4dcf31dbabe9): created successfully Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df9eeb8-597d-474a-9680-6e269f6cab2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Flow 'volume_create_manager' (ee4cba64-120d-4e00-9e78-493300f2c80f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:41 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-57029fc5-dac7-402a-a06e-319cc0bb3ff7 tempest-VolumesGetTest-1570820904 None] Created volume successfully. Apr 21 02:07:42 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0605c45e-4a45-4f56-a1b9-db74f85271ed 1073741824" returned: 0 in 0.554s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0605c45e-4a45-4f56-a1b9-db74f85271ed {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:42 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0605c45e-4a45-4f56-a1b9-db74f85271ed Apr 21 02:07:42 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Flow 'volume_create_manager' (9c3c2ac1-52b4-4c87-8b24-207dc1cd835e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db5a816-1de8-419c-9fe5-d9aba2451809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:42 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0605c45e-4a45-4f56-a1b9-db74f85271ed" returned: 0 in 0.526s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db5a816-1de8-419c-9fe5-d9aba2451809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-996457708',display_name='tempest-VolumesGetTest-Volume-436334585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1078354-dc68-4e47-a591-85308142ec22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f7efcfd60346dc9f726bdec75a13ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:43Z,use_quota=True,user_id='dd644e2eb1a94ccfa58ea69861b85983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2adeebae-195d-4167-9241-6d407a697623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2adeebae-195d-4167-9241-6d407a697623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16ebade-b77e-4092-b046-0979f4103bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16ebade-b77e-4092-b046-0979f4103bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1078354-dc68-4e47-a591-85308142ec22', 'volume_name': 'volume-d1078354-dc68-4e47-a591-85308142ec22', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715b81e0-6aef-4e7e-86f5-d5e6c9955b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715b81e0-6aef-4e7e-86f5-d5e6c9955b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f854ef-0304-4148-80ff-3b831950cc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:42 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Volume d1078354-dc68-4e47-a591-85308142ec22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1078354-dc68-4e47-a591-85308142ec22', 'volume_size': 1} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-996457708',display_name='tempest-VolumesGetTest-Volume-436334585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1078354-dc68-4e47-a591-85308142ec22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f7efcfd60346dc9f726bdec75a13ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:43Z,use_quota=True,user_id='dd644e2eb1a94ccfa58ea69861b85983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Creating volume d1078354-dc68-4e47-a591-85308142ec22 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:07:42 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d1078354-dc68-4e47-a591-85308142ec22 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dead0271-a6d6-4918-9ce1-d9f7be964774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0605c45e-4a45-4f56-a1b9-db74f85271ed', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:42 devstack sudo[87561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d1078354-dc68-4e47-a591-85308142ec22 1073741824 Apr 21 02:07:42 devstack sudo[87561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1983dcce-e905-4e95-b72e-2c78cc090248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:42 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Volume volume-0605c45e-4a45-4f56-a1b9-db74f85271ed (0605c45e-4a45-4f56-a1b9-db74f85271ed): created successfully Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1983dcce-e905-4e95-b72e-2c78cc090248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Flow 'volume_create_manager' (8d323578-42e0-46cf-8cee-79e4afbe1dcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:42 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-6d343681-5716-4952-9a68-6871739ea321 tempest-ServersNegativeTestJSON-2003590365 None] Created volume successfully. Apr 21 02:07:43 devstack sudo[87561]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d1078354-dc68-4e47-a591-85308142ec22 1073741824" returned: 0 in 0.555s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d1078354-dc68-4e47-a591-85308142ec22 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:43 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d1078354-dc68-4e47-a591-85308142ec22 Apr 21 02:07:43 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:43 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d1078354-dc68-4e47-a591-85308142ec22" returned: 0 in 0.451s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:07:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f854ef-0304-4148-80ff-3b831950cc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1078354-dc68-4e47-a591-85308142ec22', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5041bd08-29ff-4dda-863a-803f63d1ec4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:43 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Volume volume-d1078354-dc68-4e47-a591-85308142ec22 (d1078354-dc68-4e47-a591-85308142ec22): created successfully Apr 21 02:07:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5041bd08-29ff-4dda-863a-803f63d1ec4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Flow 'volume_create_manager' (9c3c2ac1-52b4-4c87-8b24-207dc1cd835e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:43 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-574d58d6-2048-41a4-8648-f6ab153db875 tempest-VolumesGetTest-1570820904 None] Created volume successfully. Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Flow 'volume_create_manager' (8461733e-3ba4-4399-8b05-403da152bac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a118ac86-9bf1-40ac-a78a-d94319835387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a118ac86-9bf1-40ac-a78a-d94319835387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1632651258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96dc4e43-3d11-4375-abc1-4f1ba38e1f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4266b773afb54b31ba7b27eb206d58f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:44Z,use_quota=True,user_id='40db7e893f9942fa952ce25d4dfc73a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23bb67fe-f91d-4d43-b400-6fc785d978f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23bb67fe-f91d-4d43-b400-6fc785d978f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78d0793-8e18-46c5-99f6-d9bcd0841a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78d0793-8e18-46c5-99f6-d9bcd0841a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96dc4e43-3d11-4375-abc1-4f1ba38e1f77', 'volume_name': 'volume-96dc4e43-3d11-4375-abc1-4f1ba38e1f77', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faca3e6f-6cbf-4a37-b4be-1caa1dd5cb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faca3e6f-6cbf-4a37-b4be-1caa1dd5cb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e992c8-828f-45b3-9fa2-98fa067b13fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:44 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Volume 96dc4e43-3d11-4375-abc1-4f1ba38e1f77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96dc4e43-3d11-4375-abc1-4f1ba38e1f77', 'volume_size': 1} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1632651258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96dc4e43-3d11-4375-abc1-4f1ba38e1f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4266b773afb54b31ba7b27eb206d58f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:44Z,use_quota=True,user_id='40db7e893f9942fa952ce25d4dfc73a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Creating volume 96dc4e43-3d11-4375-abc1-4f1ba38e1f77 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:07:44 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-96dc4e43-3d11-4375-abc1-4f1ba38e1f77 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:44 devstack sudo[87569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-96dc4e43-3d11-4375-abc1-4f1ba38e1f77 1073741824 Apr 21 02:07:44 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:44 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-96dc4e43-3d11-4375-abc1-4f1ba38e1f77 1073741824" returned: 0 in 0.624s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-96dc4e43-3d11-4375-abc1-4f1ba38e1f77 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:44 devstack sudo[87600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-96dc4e43-3d11-4375-abc1-4f1ba38e1f77 Apr 21 02:07:44 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] Acquiring lock "cinder-d1078354-dc68-4e47-a591-85308142ec22-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] Lock "cinder-d1078354-dc68-4e47-a591-85308142ec22-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] Acquiring lock "cinder-quobyte-d1078354-dc68-4e47-a591-85308142ec22" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] Lock "cinder-quobyte-d1078354-dc68-4e47-a591-85308142ec22" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:45 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[119cedac-0b72-4307-bae3-8dcd766de1df]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d1078354-dc68-4e47-a591-85308142ec22 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:45 devstack sudo[87605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d1078354-dc68-4e47-a591-85308142ec22 Apr 21 02:07:45 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:45 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-96dc4e43-3d11-4375-abc1-4f1ba38e1f77" returned: 0 in 0.565s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:45 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:07:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e992c8-828f-45b3-9fa2-98fa067b13fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96dc4e43-3d11-4375-abc1-4f1ba38e1f77', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92109073-350e-40dd-867f-ca31082fbe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:45 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Volume volume-96dc4e43-3d11-4375-abc1-4f1ba38e1f77 (96dc4e43-3d11-4375-abc1-4f1ba38e1f77): created successfully Apr 21 02:07:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92109073-350e-40dd-867f-ca31082fbe0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:45 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Flow 'volume_create_manager' (8461733e-3ba4-4399-8b05-403da152bac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:45 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-e57eb279-38d1-47b9-b506-65c6741af690 tempest-ServersNegativeTestJSON-2003590365 None] Created volume successfully. Apr 21 02:07:45 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d1078354-dc68-4e47-a591-85308142ec22" returned: 0 in 0.486s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d1078354-dc68-4e47-a591-85308142ec22 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:45 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d1078354-dc68-4e47-a591-85308142ec22 Apr 21 02:07:45 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:46 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d1078354-dc68-4e47-a591-85308142ec22" returned: 0 in 0.481s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] Lock "cinder-quobyte-d1078354-dc68-4e47-a591-85308142ec22" released by "delete_volume" :: held 0.992s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:46 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] Created reservations ['cb277fd2-2919-43c4-9718-34944c413654', '82205efe-4b50-4aba-aafa-25b200dee098', '64da7ccc-6294-43ee-aea4-22449e7a373f', '828fff12-26a0-4447-a91e-290bdf6a8f54'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:07:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:46 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:07:46 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] Acquiring lock "cinder-96dc4e43-3d11-4375-abc1-4f1ba38e1f77-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] Lock "cinder-96dc4e43-3d11-4375-abc1-4f1ba38e1f77-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] Acquiring lock "cinder-quobyte-96dc4e43-3d11-4375-abc1-4f1ba38e1f77" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] Lock "cinder-quobyte-96dc4e43-3d11-4375-abc1-4f1ba38e1f77" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:46 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eeb256-cf9f-45fb-bdef-7edb0b4a608f]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-96dc4e43-3d11-4375-abc1-4f1ba38e1f77 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:46 devstack sudo[87616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-96dc4e43-3d11-4375-abc1-4f1ba38e1f77 Apr 21 02:07:46 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:46 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.464s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:46 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:07:46 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] Deleted volume successfully. Apr 21 02:07:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-295fd443-1323-4b5e-8db8-6d212ca3fd8f tempest-VolumesGetTest-1570820904 None] Lock "cinder-d1078354-dc68-4e47-a591-85308142ec22-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:47 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-96dc4e43-3d11-4375-abc1-4f1ba38e1f77" returned: 0 in 0.524s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-96dc4e43-3d11-4375-abc1-4f1ba38e1f77 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:47 devstack sudo[87622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-96dc4e43-3d11-4375-abc1-4f1ba38e1f77 Apr 21 02:07:47 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] Acquiring lock "cinder-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] Lock "cinder-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] Acquiring lock "cinder-quobyte-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] Lock "cinder-quobyte-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9" acquired by "delete_volume" :: waited 0.020s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:47 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf74951-2b7b-4b13-90c1-27079ef597b9]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:47 devstack sudo[87625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9 Apr 21 02:07:47 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:47 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-96dc4e43-3d11-4375-abc1-4f1ba38e1f77" returned: 0 in 0.557s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] Lock "cinder-quobyte-96dc4e43-3d11-4375-abc1-4f1ba38e1f77" released by "delete_volume" :: held 1.113s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:47 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] Created reservations ['10318688-8b8c-48ec-bd76-dc36c392109f', '1f188af6-c991-46be-83f8-27bd5a791aff', '477cbc9a-ca96-4ccb-b364-47599b8df23a', '4ef5843e-214e-4166-b92d-85671d194f8f'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:07:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:47 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:07:47 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:48 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9" returned: 0 in 0.524s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:48 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9 Apr 21 02:07:48 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:48 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.440s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:07:48 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] Deleted volume successfully. Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-508fda44-854b-402a-97ac-2970ddffb018 tempest-ServersNegativeTestJSON-2003590365 None] Lock "cinder-96dc4e43-3d11-4375-abc1-4f1ba38e1f77-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:48 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9" returned: 0 in 0.443s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] Lock "cinder-quobyte-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9" released by "delete_volume" :: held 1.027s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] Created reservations ['5b95a728-0005-4d0c-835a-fa7a7aba402a', '68f0cd7b-7c4a-4dbd-86fc-83d2431ed433', '56b048b9-c8bd-4332-b553-c215541010e4', '4c32b110-5567-49fc-9949-47ebd2118fb5'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:48 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:07:48 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] Acquiring lock "cinder-0605c45e-4a45-4f56-a1b9-db74f85271ed-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] Lock "cinder-0605c45e-4a45-4f56-a1b9-db74f85271ed-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] Acquiring lock "cinder-quobyte-0605c45e-4a45-4f56-a1b9-db74f85271ed" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] Lock "cinder-quobyte-0605c45e-4a45-4f56-a1b9-db74f85271ed" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f83a4c0-6a99-4742-9251-a9872d06469b]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0605c45e-4a45-4f56-a1b9-db74f85271ed {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:48 devstack sudo[87672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0605c45e-4a45-4f56-a1b9-db74f85271ed Apr 21 02:07:48 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:49 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.533s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:07:49 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] Deleted volume successfully. Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1a6ea538-ac9e-4c31-a46f-a166d8ef56ff tempest-VolumesGetTest-1570820904 None] Lock "cinder-de93ecd2-6dd0-4263-90a2-4dcf31dbabe9-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:49 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0605c45e-4a45-4f56-a1b9-db74f85271ed" returned: 0 in 0.495s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0605c45e-4a45-4f56-a1b9-db74f85271ed {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:49 devstack sudo[87678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0605c45e-4a45-4f56-a1b9-db74f85271ed Apr 21 02:07:49 devstack sudo[87678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:49 devstack sudo[87678]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0605c45e-4a45-4f56-a1b9-db74f85271ed" returned: 0 in 0.417s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] Lock "cinder-quobyte-0605c45e-4a45-4f56-a1b9-db74f85271ed" released by "delete_volume" :: held 0.941s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] Created reservations ['01d38e72-775d-4f55-bc31-5834c62ee1ed', 'ae139e5a-15c5-4aa2-9332-da12bee0512b', '6beabf45-a5dd-4a95-8f7b-4ba14dc970fc', '0ac6e29f-2b13-4001-9bd1-7d1f9c517717'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] Acquiring lock "cinder-c9a5939d-ea4a-4585-a658-5855c7b87dbf-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] Lock "cinder-c9a5939d-ea4a-4585-a658-5855c7b87dbf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] Acquiring lock "cinder-quobyte-c9a5939d-ea4a-4585-a658-5855c7b87dbf" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] Lock "cinder-quobyte-c9a5939d-ea4a-4585-a658-5855c7b87dbf" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89ab41d-cf96-4a2f-90ac-b50b8b089ced]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:49 devstack sudo[87683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:07:49 devstack sudo[87683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:49 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf Apr 21 02:07:49 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:50 devstack sudo[87683]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.544s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:50 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:07:50 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] Deleted volume successfully. Apr 21 02:07:50 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c75653a8-53f3-4208-853c-315f046b896f tempest-ServersNegativeTestJSON-2003590365 None] Lock "cinder-0605c45e-4a45-4f56-a1b9-db74f85271ed-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:50 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf" returned: 0 in 0.641s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:50 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf Apr 21 02:07:50 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:50 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c9a5939d-ea4a-4585-a658-5855c7b87dbf" returned: 0 in 0.437s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:50 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] Lock "cinder-quobyte-c9a5939d-ea4a-4585-a658-5855c7b87dbf" released by "delete_volume" :: held 1.123s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:51 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] Created reservations ['b6fb9f48-89e3-46e4-b477-25702167bc20', '4f6591d7-98c0-4f4c-afe6-0fc15544d130', 'd78194e5-5f7e-43d2-9407-54a68bc6940e', '70ace600-0a41-4bb0-9116-72caab537258'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:07:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:51 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:51 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:51 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:07:51 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:51 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.463s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:51 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:07:51 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] Deleted volume successfully. Apr 21 02:07:51 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fa355821-f2f2-42d6-881d-1893cdadfb58 tempest-VolumesGetTest-1570820904 None] Lock "cinder-c9a5939d-ea4a-4585-a658-5855c7b87dbf-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:52 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:07:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Flow 'volume_create_manager' (2b361e0c-73e1-4040-8954-1b2852c93a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46fec1c5-9e13-420b-b321-32930af3edcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46fec1c5-9e13-420b-b321-32930af3edcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-915764772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a815ded-e798-4a93-8e7a-cc215b2dd8eb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='73f7efcfd60346dc9f726bdec75a13ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:52Z,use_quota=True,user_id='dd644e2eb1a94ccfa58ea69861b85983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36472e4-91eb-4467-8d99-d1308586316e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36472e4-91eb-4467-8d99-d1308586316e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a47466e3-bae2-4966-a24a-b9ad3b0990ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:52 devstack cinder-volume[82184]: DEBUG cinder.image.glance [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Creating Keystone auth plugin from conf {{(pid=82184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 02:07:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a47466e3-bae2-4966-a24a-b9ad3b0990ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9a815ded-e798-4a93-8e7a-cc215b2dd8eb', 'volume_name': 'volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb', 'volume_size': 1, 'image_id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b9740a9418bf48ba9dad196958886690', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'created_at': datetime.datetime(2026, 4, 20, 23, 58, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 23, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b22600ee-9d9f-4ee7-8886-ce18034d260d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a34dac9-8e99-49eb-9197-1e9221714f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a34dac9-8e99-49eb-9197-1e9221714f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ab9aa2-ad2a-4c4e-8239-a400828304aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:52 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Volume 9a815ded-e798-4a93-8e7a-cc215b2dd8eb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb', 'volume_size': 1, 'image_id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b9740a9418bf48ba9dad196958886690', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'created_at': datetime.datetime(2026, 4, 20, 23, 58, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 23, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b22600ee-9d9f-4ee7-8886-ce18034d260d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 02:07:52 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Trying to clone 9a815ded-e798-4a93-8e7a-cc215b2dd8eb from image b22600ee-9d9f-4ee7-8886-ce18034d260d at location (None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}]). {{(pid=82184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 02:07:52 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_u5agx4sfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82184) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 02:07:52 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Image download 20.69 MB at 20.69 MB/s Apr 21 02:07:52 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e05010-d705-456f-851b-5f9f5171c8e7]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_u5agx4sfdevstack@QuobyteHD {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:53 devstack sudo[87757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_u5agx4sfdevstack@QuobyteHD Apr 21 02:07:53 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:53 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_u5agx4sfdevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:53 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Temporary image b22600ee-9d9f-4ee7-8886-ce18034d260d is fetched for user dd644e2eb1a94ccfa58ea69861b85983. {{(pid=82184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 02:07:53 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08bf9c6-19c9-4a82-8d22-cab62795c57b]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_u5agx4sfdevstack@QuobyteHD {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:53 devstack sudo[87763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_u5agx4sfdevstack@QuobyteHD Apr 21 02:07:53 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:54 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_u5agx4sfdevstack@QuobyteHD" returned: 0 in 0.593s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-915764772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a815ded-e798-4a93-8e7a-cc215b2dd8eb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='73f7efcfd60346dc9f726bdec75a13ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:07:52Z,use_quota=True,user_id='dd644e2eb1a94ccfa58ea69861b85983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:07:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Creating volume 9a815ded-e798-4a93-8e7a-cc215b2dd8eb {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:07:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:07:54 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:07:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:54 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb 1073741824 Apr 21 02:07:54 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:54 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb 1073741824" returned: 0 in 0.592s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:54 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb Apr 21 02:07:54 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:55 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb" returned: 0 in 0.490s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:07:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:55 devstack cinder-volume[82184]: DEBUG cinder.volume.volume_utils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Attempting download of b22600ee-9d9f-4ee7-8886-ce18034d260d ((None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}])) to volume 9a815ded-e798-4a93-8e7a-cc215b2dd8eb. {{(pid=82184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 02:07:55 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2352e613-c12d-4056-8161-a1ec65b892ed]: (4, 'raw') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_0yzoda_d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:55 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_0yzoda_d Apr 21 02:07:55 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:55 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_0yzoda_d" returned: 0 in 0.521s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_0yzoda_d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:55 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_0yzoda_d Apr 21 02:07:55 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:56 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_0yzoda_d" returned: 1 in 0.514s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b22600ee-9d9f-4ee7-8886-ce18034d260d_0yzoda_d' failed. Not Retrying. {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 02:07:56 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5600f5fa-1197-47ad-be10-5eb4905a8906]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_u5agx4sfdevstack@QuobyteHD {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:56 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_u5agx4sfdevstack@QuobyteHD Apr 21 02:07:56 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:56 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_u5agx4sfdevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:56 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] b22600ee-9d9f-4ee7-8886-ce18034d260d was qcow2, converting to raw {{(pid=82184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 02:07:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_u5agx4sfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:56 devstack sudo[87793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_u5agx4sfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb Apr 21 02:07:56 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:57 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] Acquiring lock "cinder-84d5da26-7e44-49cb-b78c-ebc312859738-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:57 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] Lock "cinder-84d5da26-7e44-49cb-b78c-ebc312859738-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:57 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] Acquiring lock "cinder-quobyte-84d5da26-7e44-49cb-b78c-ebc312859738" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:07:57 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] Lock "cinder-quobyte-84d5da26-7e44-49cb-b78c-ebc312859738" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:07:57 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f1d1a9-2b5e-4bee-a9f7-26e5264839ed]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-84d5da26-7e44-49cb-b78c-ebc312859738 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:57 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-84d5da26-7e44-49cb-b78c-ebc312859738 Apr 21 02:07:57 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:57 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_u5agx4sfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb" returned: 0 in 0.965s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:57 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b22600ee-9d9f-4ee7-8886-ce18034d260d_u5agx4sfdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:07:57 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Converted 112.00 MB image at 112.00 MB/s Apr 21 02:07:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:57 devstack sudo[87814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb 1G Apr 21 02:07:57 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:58 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-84d5da26-7e44-49cb-b78c-ebc312859738" returned: 0 in 0.539s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-84d5da26-7e44-49cb-b78c-ebc312859738 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:58 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-84d5da26-7e44-49cb-b78c-ebc312859738 Apr 21 02:07:58 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:58 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb 1G" returned: 0 in 0.476s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:58 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aac6158-b47a-4f5e-9ad8-c46f29e43b34]: (4, 'raw') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:07:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:58 devstack sudo[87824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb Apr 21 02:07:58 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:58 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-84d5da26-7e44-49cb-b78c-ebc312859738" returned: 0 in 0.448s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:58 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] Lock "cinder-quobyte-84d5da26-7e44-49cb-b78c-ebc312859738" released by "delete_volume" :: held 1.023s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:58 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] Created reservations ['b11b2e7e-1f17-4c3e-8af8-ade6d7d96288', '7bd80856-f288-4d4d-a2d6-bae162e41c25', '64a01d0e-3ac4-4f37-ab69-b773794e3edc', '8e04d0e6-8ebf-4361-a236-908e694f3169'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:07:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:07:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:07:58 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:07:58 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:07:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:07:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:58 devstack sudo[87828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:07:58 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:58 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb" returned: 0 in 0.518s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:07:58 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb Apr 21 02:07:58 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:07:59 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.435s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:59 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:07:59 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] Deleted volume successfully. Apr 21 02:07:59 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-48f11444-e2d3-41a4-a98e-2f517cec6b79 tempest-VolumesNegativeTest-614563064 None] Lock "cinder-84d5da26-7e44-49cb-b78c-ebc312859738-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:07:59 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 21 02:07:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb" returned: 1 in 0.560s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:07:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb' failed. Not Retrying. {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 02:07:59 devstack cinder-volume[82184]: DEBUG cinder.volume.volume_utils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Downloaded image b22600ee-9d9f-4ee7-8886-ce18034d260d ((None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}])) to volume 9a815ded-e798-4a93-8e7a-cc215b2dd8eb successfully. {{(pid=82184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 02:07:59 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Temporary image b22600ee-9d9f-4ee7-8886-ce18034d260d for user dd644e2eb1a94ccfa58ea69861b85983 is deleted. {{(pid=82184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 02:07:59 devstack cinder-volume[82184]: DEBUG cinder.volume.volume_utils [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Marking volume 9a815ded-e798-4a93-8e7a-cc215b2dd8eb as bootable. {{(pid=82184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 02:07:59 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Copying metadata from image b22600ee-9d9f-4ee7-8886-ce18034d260d to 9a815ded-e798-4a93-8e7a-cc215b2dd8eb. {{(pid=82184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 02:07:59 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Creating volume glance metadata for volume 9a815ded-e798-4a93-8e7a-cc215b2dd8eb backed by image b22600ee-9d9f-4ee7-8886-ce18034d260d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 02:07:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ab9aa2-ad2a-4c4e-8239-a400828304aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb', 'volume_size': 1, 'image_id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b22600ee-9d9f-4ee7-8886-ce18034d260d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b9740a9418bf48ba9dad196958886690', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b22600ee-9d9f-4ee7-8886-ce18034d260d', 'created_at': datetime.datetime(2026, 4, 20, 23, 58, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 23, 58, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b22600ee-9d9f-4ee7-8886-ce18034d260d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc415cb9-5462-4cd8-8e81-f32c82c71f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:07:59 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Volume volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb (9a815ded-e798-4a93-8e7a-cc215b2dd8eb): created successfully Apr 21 02:07:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc415cb9-5462-4cd8-8e81-f32c82c71f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:07:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Flow 'volume_create_manager' (2b361e0c-73e1-4040-8954-1b2852c93a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:07:59 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-0f9193de-24e3-4728-888f-31ebf2fff7d1 tempest-VolumesGetTest-1570820904 None] Created volume successfully. Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Flow 'volume_create_manager' (21d6cb3c-81a5-4d51-a142-ccbea2fb6462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5637e275-9108-4c20-ba02-e0124dfee991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5637e275-9108-4c20-ba02-e0124dfee991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-171471922',display_name='tempest-VolumesGetTest-Volume-929942088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11cb9c13-2651-4e21-8e94-2e536324b062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f7efcfd60346dc9f726bdec75a13ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:00Z,use_quota=True,user_id='dd644e2eb1a94ccfa58ea69861b85983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a50a97-3cd5-4ad7-a104-3a826c65ad46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a50a97-3cd5-4ad7-a104-3a826c65ad46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9145941e-25a2-461b-b06a-b271506f3c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9145941e-25a2-461b-b06a-b271506f3c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11cb9c13-2651-4e21-8e94-2e536324b062', 'volume_name': 'volume-11cb9c13-2651-4e21-8e94-2e536324b062', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a8b019-c64a-4943-846a-e88e5aa386ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a8b019-c64a-4943-846a-e88e5aa386ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8b1852-c4a2-4aea-b56d-c0ea890c5f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:00 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Volume 11cb9c13-2651-4e21-8e94-2e536324b062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11cb9c13-2651-4e21-8e94-2e536324b062', 'volume_size': 1} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-171471922',display_name='tempest-VolumesGetTest-Volume-929942088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11cb9c13-2651-4e21-8e94-2e536324b062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f7efcfd60346dc9f726bdec75a13ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:00Z,use_quota=True,user_id='dd644e2eb1a94ccfa58ea69861b85983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Creating volume 11cb9c13-2651-4e21-8e94-2e536324b062 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:08:00 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:08:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-11cb9c13-2651-4e21-8e94-2e536324b062 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:00 devstack sudo[87839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-11cb9c13-2651-4e21-8e94-2e536324b062 1073741824 Apr 21 02:08:00 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:01 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-11cb9c13-2651-4e21-8e94-2e536324b062 1073741824" returned: 0 in 0.574s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-11cb9c13-2651-4e21-8e94-2e536324b062 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:01 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-11cb9c13-2651-4e21-8e94-2e536324b062 Apr 21 02:08:01 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Flow 'volume_create_manager' (ca0e1c50-6916-48d7-b291-ad2e66214c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80aaf6f-5fa8-42ab-9c1b-eb7ae8421463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80aaf6f-5fa8-42ab-9c1b-eb7ae8421463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-99968833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279037bd-3637-40c0-8e16-5dc9776be8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa03d40a0a847e49d943ba5ba55370b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:01Z,use_quota=True,user_id='38ccbed46a614204839d231056e077d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236c44dc-d58d-4a4e-84bc-27b67272e48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236c44dc-d58d-4a4e-84bc-27b67272e48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13cf0fe4-46d6-4906-822a-d0de4b10cd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13cf0fe4-46d6-4906-822a-d0de4b10cd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279037bd-3637-40c0-8e16-5dc9776be8ba', 'volume_name': 'volume-279037bd-3637-40c0-8e16-5dc9776be8ba', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04cc8a6-0593-43a5-a83b-6434cab6fa62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04cc8a6-0593-43a5-a83b-6434cab6fa62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ce2126-c4a4-4bf6-9193-665a99c6c96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:01 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Volume 279037bd-3637-40c0-8e16-5dc9776be8ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279037bd-3637-40c0-8e16-5dc9776be8ba', 'volume_size': 1} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:01 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-11cb9c13-2651-4e21-8e94-2e536324b062" returned: 0 in 0.506s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.110s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-99968833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279037bd-3637-40c0-8e16-5dc9776be8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa03d40a0a847e49d943ba5ba55370b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:01Z,use_quota=True,user_id='38ccbed46a614204839d231056e077d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Creating volume 279037bd-3637-40c0-8e16-5dc9776be8ba {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:08:01 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-279037bd-3637-40c0-8e16-5dc9776be8ba 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:01 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-279037bd-3637-40c0-8e16-5dc9776be8ba 1073741824 Apr 21 02:08:01 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8b1852-c4a2-4aea-b56d-c0ea890c5f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11cb9c13-2651-4e21-8e94-2e536324b062', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed2b708-d047-479b-a302-ecd744cd9481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:01 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Volume volume-11cb9c13-2651-4e21-8e94-2e536324b062 (11cb9c13-2651-4e21-8e94-2e536324b062): created successfully Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed2b708-d047-479b-a302-ecd744cd9481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Flow 'volume_create_manager' (21d6cb3c-81a5-4d51-a142-ccbea2fb6462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:01 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-947ce3d2-c90c-4919-b25e-8018b3692606 tempest-VolumesGetTest-1570820904 None] Created volume successfully. Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Flow 'volume_create_manager' (09bf58d5-78c7-4717-b44c-12e80e1914e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00e5bf3-bb47-4aa3-897a-57ec480f9b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00e5bf3-bb47-4aa3-897a-57ec480f9b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1028699838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef85b327-feb2-405b-9abc-294989314b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6770d83fe134116bae36f48bca33190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:02Z,use_quota=True,user_id='210c45d24af34e57b5be6887de514013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec36e58a-42da-486b-85d9-b2bb75fa34a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec36e58a-42da-486b-85d9-b2bb75fa34a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8251d77-b627-43c2-b724-75d50a55d145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8251d77-b627-43c2-b724-75d50a55d145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef85b327-feb2-405b-9abc-294989314b57', 'volume_name': 'volume-ef85b327-feb2-405b-9abc-294989314b57', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc08ae49-3455-4aad-81cc-3ad4fe75c1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc08ae49-3455-4aad-81cc-3ad4fe75c1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec225040-10b7-4ca8-83de-bc33921059da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:01 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Volume ef85b327-feb2-405b-9abc-294989314b57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef85b327-feb2-405b-9abc-294989314b57', 'volume_size': 1} Apr 21 02:08:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:02 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-279037bd-3637-40c0-8e16-5dc9776be8ba 1073741824" returned: 0 in 0.525s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-279037bd-3637-40c0-8e16-5dc9776be8ba {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:02 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-279037bd-3637-40c0-8e16-5dc9776be8ba Apr 21 02:08:02 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] Acquiring lock "cinder-11cb9c13-2651-4e21-8e94-2e536324b062-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] Lock "cinder-11cb9c13-2651-4e21-8e94-2e536324b062-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] Acquiring lock "cinder-quobyte-11cb9c13-2651-4e21-8e94-2e536324b062" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:02 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-279037bd-3637-40c0-8e16-5dc9776be8ba" returned: 0 in 0.429s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] Lock "cinder-quobyte-11cb9c13-2651-4e21-8e94-2e536324b062" acquired by "delete_volume" :: waited 0.019s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.741s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1028699838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef85b327-feb2-405b-9abc-294989314b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6770d83fe134116bae36f48bca33190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:02Z,use_quota=True,user_id='210c45d24af34e57b5be6887de514013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Creating volume ef85b327-feb2-405b-9abc-294989314b57 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:08:02 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fe1c34-14cd-49da-a817-1d40751f407a]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-11cb9c13-2651-4e21-8e94-2e536324b062 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:02 devstack sudo[87855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57 1073741824 Apr 21 02:08:02 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ce2126-c4a4-4bf6-9193-665a99c6c96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279037bd-3637-40c0-8e16-5dc9776be8ba', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6ca67a-72e1-4280-8458-78c02b307e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:02 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Volume volume-279037bd-3637-40c0-8e16-5dc9776be8ba (279037bd-3637-40c0-8e16-5dc9776be8ba): created successfully Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6ca67a-72e1-4280-8458-78c02b307e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:02 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Flow 'volume_create_manager' (ca0e1c50-6916-48d7-b291-ad2e66214c1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:02 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-ba8a381e-de19-4161-b560-109c943ec53a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Created volume successfully. Apr 21 02:08:02 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-11cb9c13-2651-4e21-8e94-2e536324b062 Apr 21 02:08:02 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:03 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57 1073741824" returned: 0 in 0.466s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:03 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:03 devstack sudo[87865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57 Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-11cb9c13-2651-4e21-8e94-2e536324b062" returned: 0 in 0.492s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:03 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-11cb9c13-2651-4e21-8e94-2e536324b062 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:03 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-11cb9c13-2651-4e21-8e94-2e536324b062 Apr 21 02:08:03 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:03 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57" returned: 0 in 0.424s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec225040-10b7-4ca8-83de-bc33921059da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef85b327-feb2-405b-9abc-294989314b57', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:03 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af937d6d-b2a8-4cdf-8af4-41e9106f0956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-11cb9c13-2651-4e21-8e94-2e536324b062" returned: 0 in 0.429s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] Lock "cinder-quobyte-11cb9c13-2651-4e21-8e94-2e536324b062" released by "delete_volume" :: held 0.956s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:03 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Volume volume-ef85b327-feb2-405b-9abc-294989314b57 (ef85b327-feb2-405b-9abc-294989314b57): created successfully Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af937d6d-b2a8-4cdf-8af4-41e9106f0956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Flow 'volume_create_manager' (09bf58d5-78c7-4717-b44c-12e80e1914e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] Created reservations ['e12af0a3-2c85-4e9e-83a2-a8e468ab92c4', 'de18107c-ef7d-4973-8677-67f241d3844b', '7bd8373e-bf63-41c0-a3c9-6cd1a2e2e49d', '3c625e10-25d3-458f-bd4b-468ad0fc8800'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:03 devstack cinder-volume[82184]: INFO cinder.volume.manager [req-35cbb08e-3a8c-4342-a4ff-a91004442989 req-254f23ed-9da9-4bee-a78e-dac5ac1f8efd tempest-VolumesSnapshotsTestJSON-710841662 None] Created volume successfully. Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:03 devstack sudo[87871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:08:03 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Flow 'volume_create_manager' (a92bdf96-2389-4e0e-b178-46845d889e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7beb716c-0e59-4c66-9a7d-f89699cd3c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7beb716c-0e59-4c66-9a7d-f89699cd3c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1106380662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36012da8-e24e-49cf-8c7a-030c1dc4eb03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa03d40a0a847e49d943ba5ba55370b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:04Z,use_quota=True,user_id='38ccbed46a614204839d231056e077d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9fda0c-558d-4caf-8ce0-a39708abb375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9fda0c-558d-4caf-8ce0-a39708abb375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e0d174-6b37-41f9-bdab-ffed6663266c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e0d174-6b37-41f9-bdab-ffed6663266c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36012da8-e24e-49cf-8c7a-030c1dc4eb03', 'volume_name': 'volume-36012da8-e24e-49cf-8c7a-030c1dc4eb03', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d209db-a3b6-4c6a-a904-e3a14d22e92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d209db-a3b6-4c6a-a904-e3a14d22e92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96876c7d-5860-47ae-b57f-6c24a7fa02aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:03 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Volume 36012da8-e24e-49cf-8c7a-030c1dc4eb03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36012da8-e24e-49cf-8c7a-030c1dc4eb03', 'volume_size': 1} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1106380662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36012da8-e24e-49cf-8c7a-030c1dc4eb03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa03d40a0a847e49d943ba5ba55370b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:04Z,use_quota=True,user_id='38ccbed46a614204839d231056e077d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Creating volume 36012da8-e24e-49cf-8c7a-030c1dc4eb03 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:08:03 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:08:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-36012da8-e24e-49cf-8c7a-030c1dc4eb03 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:03 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-36012da8-e24e-49cf-8c7a-030c1dc4eb03 1073741824 Apr 21 02:08:03 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Flow 'volume_create_manager' (78b0d109-7da8-4309-b2b3-bdaa46a401b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46959837-b1c2-4583-bbe7-4b6020884d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46959837-b1c2-4583-bbe7-4b6020884d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-528131393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1e85c5-9aa8-41ef-a0db-e331655b601f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa03d40a0a847e49d943ba5ba55370b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:04Z,use_quota=True,user_id='38ccbed46a614204839d231056e077d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3b7ee6-0c6a-4869-aba5-a3521abe09fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3b7ee6-0c6a-4869-aba5-a3521abe09fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8a98a6-a475-4edd-98c2-bdaef04e2a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8a98a6-a475-4edd-98c2-bdaef04e2a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de1e85c5-9aa8-41ef-a0db-e331655b601f', 'volume_name': 'volume-de1e85c5-9aa8-41ef-a0db-e331655b601f', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aadfca5-ec38-4239-a6f3-21d05482df5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aadfca5-ec38-4239-a6f3-21d05482df5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c8eabe-357e-42e0-9390-a46a29a3d159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Volume de1e85c5-9aa8-41ef-a0db-e331655b601f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de1e85c5-9aa8-41ef-a0db-e331655b601f', 'volume_size': 1} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.517s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:08:04 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] Deleted volume successfully. Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a200db28-a53c-4fb4-88be-b267f75aa4c1 tempest-VolumesGetTest-1570820904 None] Lock "cinder-11cb9c13-2651-4e21-8e94-2e536324b062-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Flow 'volume_create_manager' (220d246b-8290-42c5-a4ce-69a6c850e7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9bf1f31-5789-4e27-ad21-b60339fc53af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9bf1f31-5789-4e27-ad21-b60339fc53af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-9685559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b6efe1-d177-4149-898a-eb26ee308b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa03d40a0a847e49d943ba5ba55370b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:04Z,use_quota=True,user_id='38ccbed46a614204839d231056e077d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93dcef46-0c62-4a6c-b500-a01055d3b75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93dcef46-0c62-4a6c-b500-a01055d3b75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1738f6-d7e4-4e8e-92bb-1b58a529a4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1738f6-d7e4-4e8e-92bb-1b58a529a4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15b6efe1-d177-4149-898a-eb26ee308b4c', 'volume_name': 'volume-15b6efe1-d177-4149-898a-eb26ee308b4c', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85bc5617-f2ab-4c9f-8cf2-eb1e6e23c0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85bc5617-f2ab-4c9f-8cf2-eb1e6e23c0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47dc26c0-5df1-47cc-a584-3a32f885ac86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Volume 15b6efe1-d177-4149-898a-eb26ee308b4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15b6efe1-d177-4149-898a-eb26ee308b4c', 'volume_size': 1} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Flow 'volume_create_manager' (73547007-c02d-4d31-a549-9e5f5fccaf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a601a010-67e2-45cf-8fc3-5a9a19c42e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a601a010-67e2-45cf-8fc3-5a9a19c42e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-297294849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03aa6b0b-b4e3-498c-8f1f-30ca02078faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa03d40a0a847e49d943ba5ba55370b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:04Z,use_quota=True,user_id='38ccbed46a614204839d231056e077d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8eccf99-ae24-4c7b-87d4-d75565b5a848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8eccf99-ae24-4c7b-87d4-d75565b5a848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b289b942-e76d-44a3-8e89-8d3904f2963e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b289b942-e76d-44a3-8e89-8d3904f2963e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03aa6b0b-b4e3-498c-8f1f-30ca02078faf', 'volume_name': 'volume-03aa6b0b-b4e3-498c-8f1f-30ca02078faf', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb8119e-95d8-4fba-960a-a629f9c1bb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb8119e-95d8-4fba-960a-a629f9c1bb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e4faaf-bb0d-48b2-87bf-41f25a2ec0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Volume 03aa6b0b-b4e3-498c-8f1f-30ca02078faf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03aa6b0b-b4e3-498c-8f1f-30ca02078faf', 'volume_size': 1} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:04 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-36012da8-e24e-49cf-8c7a-030c1dc4eb03 1073741824" returned: 0 in 0.690s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Flow 'volume_create_manager' (92b1f18c-5248-4aa6-b086-3d8ac528cf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e71213d-d3f4-4700-9833-4b1d85810d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-36012da8-e24e-49cf-8c7a-030c1dc4eb03 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:04 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-36012da8-e24e-49cf-8c7a-030c1dc4eb03 Apr 21 02:08:04 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e71213d-d3f4-4700-9833-4b1d85810d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-651866048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa431fb-1953-4915-a704-59b7d723e6b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa03d40a0a847e49d943ba5ba55370b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:05Z,use_quota=True,user_id='38ccbed46a614204839d231056e077d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022c9b1f-5b38-4d54-bc8e-75491be003b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022c9b1f-5b38-4d54-bc8e-75491be003b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f167eafa-8c1d-4b42-9c6f-405933cdf71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f167eafa-8c1d-4b42-9c6f-405933cdf71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aa431fb-1953-4915-a704-59b7d723e6b5', 'volume_name': 'volume-1aa431fb-1953-4915-a704-59b7d723e6b5', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe77195d-1a1d-457a-bf20-076360180f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe77195d-1a1d-457a-bf20-076360180f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97aea090-26e8-47c1-9faf-203b9c362075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:04 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Volume 1aa431fb-1953-4915-a704-59b7d723e6b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aa431fb-1953-4915-a704-59b7d723e6b5', 'volume_size': 1} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] Acquiring lock "cinder-9a815ded-e798-4a93-8e7a-cc215b2dd8eb-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] Lock "cinder-9a815ded-e798-4a93-8e7a-cc215b2dd8eb-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] Acquiring lock "cinder-quobyte-9a815ded-e798-4a93-8e7a-cc215b2dd8eb" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] Lock "cinder-quobyte-9a815ded-e798-4a93-8e7a-cc215b2dd8eb" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fb70c9-a8d3-40f8-b47e-3cf852c84190]: (4, 'raw') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:04 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb Apr 21 02:08:04 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:05 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-36012da8-e24e-49cf-8c7a-030c1dc4eb03" returned: 0 in 0.433s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.852s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-528131393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1e85c5-9aa8-41ef-a0db-e331655b601f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa03d40a0a847e49d943ba5ba55370b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:04Z,use_quota=True,user_id='38ccbed46a614204839d231056e077d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Creating volume de1e85c5-9aa8-41ef-a0db-e331655b601f {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:08:05 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de1e85c5-9aa8-41ef-a0db-e331655b601f 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96876c7d-5860-47ae-b57f-6c24a7fa02aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36012da8-e24e-49cf-8c7a-030c1dc4eb03', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:05 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de1e85c5-9aa8-41ef-a0db-e331655b601f 1073741824 Apr 21 02:08:05 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e833c60-b401-430f-9a76-21815544b1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:05 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Volume volume-36012da8-e24e-49cf-8c7a-030c1dc4eb03 (36012da8-e24e-49cf-8c7a-030c1dc4eb03): created successfully Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e833c60-b401-430f-9a76-21815544b1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Flow 'volume_create_manager' (a92bdf96-2389-4e0e-b178-46845d889e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:05 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-250d8cdb-92bd-494e-8a95-1eb947faacf9 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Created volume successfully. Apr 21 02:08:05 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb" returned: 0 in 0.462s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:05 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb Apr 21 02:08:05 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:05 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de1e85c5-9aa8-41ef-a0db-e331655b601f 1073741824" returned: 0 in 0.486s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de1e85c5-9aa8-41ef-a0db-e331655b601f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:05 devstack sudo[87895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de1e85c5-9aa8-41ef-a0db-e331655b601f Apr 21 02:08:05 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:05 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb" returned: 1 in 0.501s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb' failed. Not Retrying. {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:05 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb Apr 21 02:08:05 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:05 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de1e85c5-9aa8-41ef-a0db-e331655b601f" returned: 0 in 0.424s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.594s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-9685559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b6efe1-d177-4149-898a-eb26ee308b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa03d40a0a847e49d943ba5ba55370b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:04Z,use_quota=True,user_id='38ccbed46a614204839d231056e077d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Creating volume 15b6efe1-d177-4149-898a-eb26ee308b4c {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:08:06 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-15b6efe1-d177-4149-898a-eb26ee308b4c 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c8eabe-357e-42e0-9390-a46a29a3d159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de1e85c5-9aa8-41ef-a0db-e331655b601f', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ebbe688-8e76-4d73-a02a-f36c42dc95d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:06 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-15b6efe1-d177-4149-898a-eb26ee308b4c 1073741824 Apr 21 02:08:06 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:06 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Volume volume-de1e85c5-9aa8-41ef-a0db-e331655b601f (de1e85c5-9aa8-41ef-a0db-e331655b601f): created successfully Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ebbe688-8e76-4d73-a02a-f36c42dc95d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Flow 'volume_create_manager' (78b0d109-7da8-4309-b2b3-bdaa46a401b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:06 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-4344d088-f7ab-4572-92ed-3f3c0aa61d62 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Created volume successfully. Apr 21 02:08:06 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9a815ded-e798-4a93-8e7a-cc215b2dd8eb" returned: 0 in 0.439s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] Lock "cinder-quobyte-9a815ded-e798-4a93-8e7a-cc215b2dd8eb" released by "delete_volume" :: held 1.451s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] Created reservations ['0749d4c4-3653-481f-b312-fd837a2a15a2', 'd45e393d-df98-43cb-b119-41fe0d1a84fd', 'e74257e9-b2da-41e2-a24b-7a94eac9d8d7', 'e7163be1-ee69-4ee5-9230-5ca2b13effdd'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:06 devstack sudo[87909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:08:06 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:06 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-15b6efe1-d177-4149-898a-eb26ee308b4c 1073741824" returned: 0 in 0.474s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-15b6efe1-d177-4149-898a-eb26ee308b4c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:06 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-15b6efe1-d177-4149-898a-eb26ee308b4c Apr 21 02:08:06 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:06 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.438s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:08:06 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] Deleted volume successfully. Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2da2ec4e-6efa-4467-aaee-18982f27e6f7 tempest-VolumesGetTest-1570820904 None] Lock "cinder-9a815ded-e798-4a93-8e7a-cc215b2dd8eb-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:06 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-15b6efe1-d177-4149-898a-eb26ee308b4c" returned: 0 in 0.411s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.373s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-297294849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03aa6b0b-b4e3-498c-8f1f-30ca02078faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa03d40a0a847e49d943ba5ba55370b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:04Z,use_quota=True,user_id='38ccbed46a614204839d231056e077d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Creating volume 03aa6b0b-b4e3-498c-8f1f-30ca02078faf {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:08:06 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03aa6b0b-b4e3-498c-8f1f-30ca02078faf 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:06 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03aa6b0b-b4e3-498c-8f1f-30ca02078faf 1073741824 Apr 21 02:08:06 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47dc26c0-5df1-47cc-a584-3a32f885ac86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b6efe1-d177-4149-898a-eb26ee308b4c', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926b7907-6506-4162-8107-af3330df2aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:06 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Volume volume-15b6efe1-d177-4149-898a-eb26ee308b4c (15b6efe1-d177-4149-898a-eb26ee308b4c): created successfully Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926b7907-6506-4162-8107-af3330df2aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Flow 'volume_create_manager' (220d246b-8290-42c5-a4ce-69a6c850e7ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:06 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-7b7d0c4b-007d-49db-ba71-d30418a98293 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Created volume successfully. Apr 21 02:08:07 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03aa6b0b-b4e3-498c-8f1f-30ca02078faf 1073741824" returned: 0 in 0.538s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03aa6b0b-b4e3-498c-8f1f-30ca02078faf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:07 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03aa6b0b-b4e3-498c-8f1f-30ca02078faf Apr 21 02:08:07 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:07 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03aa6b0b-b4e3-498c-8f1f-30ca02078faf" returned: 0 in 0.442s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:07 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:08:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.384s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:07 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] Creating offline snapshot a0513c42-fd6c-49fb-bc16-0c579d58b455 of volume ef85b327-feb2-405b-9abc-294989314b57 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:08:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e4faaf-bb0d-48b2-87bf-41f25a2ec0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03aa6b0b-b4e3-498c-8f1f-30ca02078faf', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8dd4cd-1773-426d-b880-94f6e9cc58ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:07 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dc7816-be1c-4f99-a571-3e5eb218213d]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:07 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Volume volume-03aa6b0b-b4e3-498c-8f1f-30ca02078faf (03aa6b0b-b4e3-498c-8f1f-30ca02078faf): created successfully Apr 21 02:08:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8dd4cd-1773-426d-b880-94f6e9cc58ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Flow 'volume_create_manager' (73547007-c02d-4d31-a549-9e5f5fccaf67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:07 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-5a002b3c-17eb-42d0-81d1-147f0ae17a7c tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Created volume successfully. Apr 21 02:08:08 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57 Apr 21 02:08:08 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:08 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57" returned: 0 in 0.490s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:08 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455 1G Apr 21 02:08:08 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:09 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455 1G" returned: 0 in 0.563s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef85b327-feb2-405b-9abc-294989314b57 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:09 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef85b327-feb2-405b-9abc-294989314b57 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455 Apr 21 02:08:09 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:09 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef85b327-feb2-405b-9abc-294989314b57 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455" returned: 0 in 0.475s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:09 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455 is being set with open permissions: ugo+rw Apr 21 02:08:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:09 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455 Apr 21 02:08:09 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:09 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455" returned: 0 in 0.449s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:09 devstack sudo[87941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.info Apr 21 02:08:09 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:10 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.info" returned: 0 in 0.435s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:10 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.info is being set with open permissions: ugo+rw Apr 21 02:08:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:10 devstack sudo[87944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.info Apr 21 02:08:10 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:10 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.info" returned: 0 in 0.436s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.918s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.196s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:10 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-651866048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa431fb-1953-4915-a704-59b7d723e6b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa03d40a0a847e49d943ba5ba55370b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:05Z,use_quota=True,user_id='38ccbed46a614204839d231056e077d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:08:10 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Creating volume 1aa431fb-1953-4915-a704-59b7d723e6b5 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:08:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:10 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:10 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:10 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:08:10 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:08:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1aa431fb-1953-4915-a704-59b7d723e6b5 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:10 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:SELECT=123,cinder:UPDATE=178,cinder:INSERT=48,cinder:DELETE=21 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:08:10 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1aa431fb-1953-4915-a704-59b7d723e6b5 1073741824 Apr 21 02:08:10 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:10 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:SELECT=135,cinder:UPDATE=186,cinder:DELETE=12,cinder:INSERT=47 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:08:10 devstack cinder-volume[82184]: INFO cinder.volume.manager [req-254e7de3-e31d-443e-9522-4869436dcdc1 req-1defc347-e956-4b74-811f-40a3daddf648 tempest-VolumesSnapshotsTestJSON-710841662 None] Create snapshot completed successfully Apr 21 02:08:11 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1aa431fb-1953-4915-a704-59b7d723e6b5 1073741824" returned: 0 in 0.570s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1aa431fb-1953-4915-a704-59b7d723e6b5 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:11 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1aa431fb-1953-4915-a704-59b7d723e6b5 Apr 21 02:08:11 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] Acquiring lock "cinder-a0513c42-fd6c-49fb-bc16-0c579d58b455-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] Lock "cinder-a0513c42-fd6c-49fb-bc16-0c579d58b455-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] Acquiring lock "cinder-quobyte-ef85b327-feb2-405b-9abc-294989314b57" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] Lock "cinder-quobyte-ef85b327-feb2-405b-9abc-294989314b57" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] Acquiring lock "cinder-quobyte-a0513c42-fd6c-49fb-bc16-0c579d58b455" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] Lock "cinder-quobyte-a0513c42-fd6c-49fb-bc16-0c579d58b455" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] Deleting offline snapshot a0513c42-fd6c-49fb-bc16-0c579d58b455 of volume ef85b327-feb2-405b-9abc-294989314b57 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] snapshot_file for this snap is: volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0863840c-53db-40cf-bf6b-8c5966810f1c]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:11 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1aa431fb-1953-4915-a704-59b7d723e6b5" returned: 0 in 0.466s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97aea090-26e8-47c1-9faf-203b9c362075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aa431fb-1953-4915-a704-59b7d723e6b5', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b19fd15-62f0-4cc7-ab5e-f7840918f35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:11 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Volume volume-1aa431fb-1953-4915-a704-59b7d723e6b5 (1aa431fb-1953-4915-a704-59b7d723e6b5): created successfully Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b19fd15-62f0-4cc7-ab5e-f7840918f35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:11 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Flow 'volume_create_manager' (92b1f18c-5248-4aa6-b086-3d8ac528cf53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:11 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-e0033afb-4c80-4866-aee1-b387c3fdd412 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Created volume successfully. Apr 21 02:08:11 devstack sudo[87955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455 Apr 21 02:08:11 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:12 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "cinder-1aa431fb-1953-4915-a704-59b7d723e6b5-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:12 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-1aa431fb-1953-4915-a704-59b7d723e6b5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:12 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "cinder-quobyte-1aa431fb-1953-4915-a704-59b7d723e6b5" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:12 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-quobyte-1aa431fb-1953-4915-a704-59b7d723e6b5" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:12 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27275a5-ae86-427a-a878-b88aa41cb339]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1aa431fb-1953-4915-a704-59b7d723e6b5 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:12 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1aa431fb-1953-4915-a704-59b7d723e6b5 Apr 21 02:08:12 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:12 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455" returned: 0 in 0.562s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:12 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef85b327-feb2-405b-9abc-294989314b57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:08:12 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d01b0d-f661-43a9-bd47-f98f8219dea9]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:12 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57 Apr 21 02:08:12 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:12 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1aa431fb-1953-4915-a704-59b7d723e6b5" returned: 0 in 0.520s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1aa431fb-1953-4915-a704-59b7d723e6b5 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:12 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1aa431fb-1953-4915-a704-59b7d723e6b5 Apr 21 02:08:12 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:12 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57" returned: 0 in 0.537s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:13 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455 Apr 21 02:08:13 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:13 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1aa431fb-1953-4915-a704-59b7d723e6b5" returned: 0 in 0.533s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:13 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-quobyte-1aa431fb-1953-4915-a704-59b7d723e6b5" released by "delete_volume" :: held 1.075s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:13 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Created reservations ['e5154f6f-485c-4de7-8307-9c8a4660715e', 'e13a0bd0-322d-4afc-9a82-3bfb41b4bd1e', '5de0328d-cf54-4396-b7a4-79c53f75125f', 'a64e9fcb-bba8-4d97-9c41-5a56ce5249f7'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:13 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:13 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:13 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:08:13 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:13 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455" returned: 0 in 0.510s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:13 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455 Apr 21 02:08:13 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:13 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.443s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:13 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:08:13 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Deleted volume successfully. Apr 21 02:08:13 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c95ab87b-8f41-4e34-98d5-58b81a1813ed tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-1aa431fb-1953-4915-a704-59b7d723e6b5-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:14 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57.a0513c42-fd6c-49fb-bc16-0c579d58b455" returned: 0 in 0.525s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] Lock "cinder-quobyte-a0513c42-fd6c-49fb-bc16-0c579d58b455" released by "_delete_snapshot" :: held 2.201s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] Lock "cinder-quobyte-ef85b327-feb2-405b-9abc-294989314b57" released by "delete_snapshot" :: held 2.215s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.quota [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] Created reservations ['7eb47ba6-a0bc-452b-9c29-8ab048bc0489', '4a72b40e-f858-49d2-86ad-6c3ed2af5f7a', 'c6c17475-f37a-4d64-9f27-46af36963c3a', 'f36fd41f-aefd-493e-a4c9-74ea96bb7ed0'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:14 devstack cinder-volume[82184]: INFO cinder.volume.manager [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] Delete snapshot completed successfully. Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-082c3e6f-cc31-4290-a9ec-5d14fcaa2e35 req-92168543-4d1b-4957-b959-34c9ff9b33a7 tempest-VolumesSnapshotsTestJSON-710841662 None] Lock "cinder-a0513c42-fd6c-49fb-bc16-0c579d58b455-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "cinder-03aa6b0b-b4e3-498c-8f1f-30ca02078faf-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-03aa6b0b-b4e3-498c-8f1f-30ca02078faf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "cinder-quobyte-03aa6b0b-b4e3-498c-8f1f-30ca02078faf" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-quobyte-03aa6b0b-b4e3-498c-8f1f-30ca02078faf" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dba6573-d0e6-49e2-80ae-4101d4a10a40]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03aa6b0b-b4e3-498c-8f1f-30ca02078faf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:14 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03aa6b0b-b4e3-498c-8f1f-30ca02078faf Apr 21 02:08:14 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Flow 'volume_create_manager' (b198cca9-dd49-480b-b166-37841bb1beae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65425a62-9d74-4b81-9fc7-06af8f29b301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65425a62-9d74-4b81-9fc7-06af8f29b301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2141699236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b90da54-9c92-46d5-882d-ef42cbf99f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54b468c734a4158b61b488755f6d91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:14Z,use_quota=True,user_id='370b1f6cd9e2473db4e6343a1d4c963f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fedb6f-0344-4cf6-98bc-1192f1593a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fedb6f-0344-4cf6-98bc-1192f1593a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523a8169-cd1f-4883-a468-7d0b3a77d66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523a8169-cd1f-4883-a468-7d0b3a77d66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b90da54-9c92-46d5-882d-ef42cbf99f61', 'volume_name': 'volume-4b90da54-9c92-46d5-882d-ef42cbf99f61', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a43f88ba-5287-4c1d-95ca-9f3f79469377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a43f88ba-5287-4c1d-95ca-9f3f79469377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe44b767-d581-46bb-a95e-fb1fd1a61dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:14 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Volume 4b90da54-9c92-46d5-882d-ef42cbf99f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b90da54-9c92-46d5-882d-ef42cbf99f61', 'volume_size': 1} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2141699236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b90da54-9c92-46d5-882d-ef42cbf99f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54b468c734a4158b61b488755f6d91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:14Z,use_quota=True,user_id='370b1f6cd9e2473db4e6343a1d4c963f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Creating volume 4b90da54-9c92-46d5-882d-ef42cbf99f61 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:08:14 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:14 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61 1073741824 Apr 21 02:08:14 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:14 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03aa6b0b-b4e3-498c-8f1f-30ca02078faf" returned: 0 in 0.528s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03aa6b0b-b4e3-498c-8f1f-30ca02078faf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:14 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03aa6b0b-b4e3-498c-8f1f-30ca02078faf Apr 21 02:08:14 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] Acquiring lock "cinder-ef85b327-feb2-405b-9abc-294989314b57-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] Lock "cinder-ef85b327-feb2-405b-9abc-294989314b57-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] Acquiring lock "cinder-quobyte-ef85b327-feb2-405b-9abc-294989314b57" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] Lock "cinder-quobyte-ef85b327-feb2-405b-9abc-294989314b57" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:15 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61 1073741824" returned: 0 in 0.557s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b958cc-8885-4d6f-b606-23b625fb7b40]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:15 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61 Apr 21 02:08:15 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:15 devstack sudo[88001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57 Apr 21 02:08:15 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:15 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-03aa6b0b-b4e3-498c-8f1f-30ca02078faf" returned: 0 in 0.467s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-quobyte-03aa6b0b-b4e3-498c-8f1f-30ca02078faf" released by "delete_volume" :: held 1.023s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Created reservations ['c007e8ce-8243-4860-9923-193042b116eb', '7d33496d-5083-4716-8127-2ed8d18e572a', '17937165-7342-4dcf-841b-d9de312ff7d8', '340e02dd-ef84-4419-a750-030aa65cd3c6'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:15 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:08:15 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:15 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61" returned: 0 in 0.449s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe44b767-d581-46bb-a95e-fb1fd1a61dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b90da54-9c92-46d5-882d-ef42cbf99f61', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22633a54-edbc-499b-8077-70fab53dd2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:15 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Volume volume-4b90da54-9c92-46d5-882d-ef42cbf99f61 (4b90da54-9c92-46d5-882d-ef42cbf99f61): created successfully Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22633a54-edbc-499b-8077-70fab53dd2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Flow 'volume_create_manager' (b198cca9-dd49-480b-b166-37841bb1beae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:15 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57" returned: 0 in 0.512s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:15 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-a7c8bc44-02fb-478c-aed3-d69d8af2dd4a tempest-VolumesSnapshotTestJSON-575949388 None] Created volume successfully. Apr 21 02:08:15 devstack sudo[88012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57 Apr 21 02:08:15 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:15 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.442s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:08:15 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Deleted volume successfully. Apr 21 02:08:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1d8e87a7-fc54-4aa6-a372-8d59ee26850f tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-03aa6b0b-b4e3-498c-8f1f-30ca02078faf-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:16 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ef85b327-feb2-405b-9abc-294989314b57" returned: 0 in 0.415s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] Lock "cinder-quobyte-ef85b327-feb2-405b-9abc-294989314b57" released by "delete_volume" :: held 0.966s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG cinder.quota [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] Created reservations ['13142d8a-07c9-4b78-87b8-1e854e4716f2', 'fd717cb9-93bb-41a5-aa22-840bdf160b56', '9cfba34b-7786-4488-a0bb-7093a7151ea8', 'd82b1916-0a8d-49e7-81cb-ba8fa2f93eb9'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:16 devstack sudo[88016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:08:16 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "cinder-15b6efe1-d177-4149-898a-eb26ee308b4c-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-15b6efe1-d177-4149-898a-eb26ee308b4c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "cinder-quobyte-15b6efe1-d177-4149-898a-eb26ee308b4c" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-quobyte-15b6efe1-d177-4149-898a-eb26ee308b4c" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[299ea230-1089-4e20-a596-4ca52e796ace]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-15b6efe1-d177-4149-898a-eb26ee308b4c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:16 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.526s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG cinder.manager [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:08:16 devstack cinder-volume[82184]: INFO cinder.volume.manager [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] Deleted volume successfully. Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [req-39cea097-516e-461f-b475-18f3d81bdfe5 req-ff0e2222-8c10-4982-b24c-5a0376aa72cc tempest-VolumesSnapshotsTestJSON-710841662 None] Lock "cinder-ef85b327-feb2-405b-9abc-294989314b57-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:16 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-15b6efe1-d177-4149-898a-eb26ee308b4c Apr 21 02:08:16 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] Creating offline snapshot ba7122bc-c6bc-4626-b609-49658bb77427 of volume 4b90da54-9c92-46d5-882d-ef42cbf99f61 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c9bb3f-3f5b-4baa-9b67-7b21b220af96]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:16 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61 Apr 21 02:08:16 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:17 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-15b6efe1-d177-4149-898a-eb26ee308b4c" returned: 0 in 0.562s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-15b6efe1-d177-4149-898a-eb26ee308b4c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:17 devstack sudo[88026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-15b6efe1-d177-4149-898a-eb26ee308b4c Apr 21 02:08:17 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:17 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61" returned: 0 in 0.559s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:17 devstack sudo[88031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427 1G Apr 21 02:08:17 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:17 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-15b6efe1-d177-4149-898a-eb26ee308b4c" returned: 0 in 0.488s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-quobyte-15b6efe1-d177-4149-898a-eb26ee308b4c" released by "delete_volume" :: held 1.077s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:17 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Created reservations ['1604e37b-98b6-4627-b3aa-bc6fe777e8ba', '4b3a05ce-a60a-41f9-9975-9b3a0f6932ed', '16f13d0a-0a45-47eb-b360-be93d8cbada7', 'af4d4973-b137-49d1-9eb2-6a06769f00d9'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:17 devstack sudo[88036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:08:17 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:17 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427 1G" returned: 0 in 0.568s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b90da54-9c92-46d5-882d-ef42cbf99f61 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:18 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b90da54-9c92-46d5-882d-ef42cbf99f61 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427 Apr 21 02:08:18 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:18 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.509s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:18 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:08:18 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Deleted volume successfully. Apr 21 02:08:18 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7582acb3-2239-40fe-8043-a0854cc456b8 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-15b6efe1-d177-4149-898a-eb26ee308b4c-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:18 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b90da54-9c92-46d5-882d-ef42cbf99f61 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427" returned: 0 in 0.482s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:18 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427 is being set with open permissions: ugo+rw Apr 21 02:08:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:18 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427 Apr 21 02:08:18 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:18 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "cinder-de1e85c5-9aa8-41ef-a0db-e331655b601f-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:18 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-de1e85c5-9aa8-41ef-a0db-e331655b601f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:18 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "cinder-quobyte-de1e85c5-9aa8-41ef-a0db-e331655b601f" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:18 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-quobyte-de1e85c5-9aa8-41ef-a0db-e331655b601f" acquired by "delete_volume" :: waited 0.022s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:18 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8506d4ef-e581-414b-8958-2f65556fe5e8]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de1e85c5-9aa8-41ef-a0db-e331655b601f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:18 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de1e85c5-9aa8-41ef-a0db-e331655b601f Apr 21 02:08:18 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:19 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427" returned: 0 in 0.522s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:19 devstack sudo[88050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.info Apr 21 02:08:19 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:19 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de1e85c5-9aa8-41ef-a0db-e331655b601f" returned: 0 in 0.564s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de1e85c5-9aa8-41ef-a0db-e331655b601f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:19 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de1e85c5-9aa8-41ef-a0db-e331655b601f Apr 21 02:08:19 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:19 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.info" returned: 0 in 0.434s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:19 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.info is being set with open permissions: ugo+rw Apr 21 02:08:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:19 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.info Apr 21 02:08:19 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:19 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-de1e85c5-9aa8-41ef-a0db-e331655b601f" returned: 0 in 0.470s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-quobyte-de1e85c5-9aa8-41ef-a0db-e331655b601f" released by "delete_volume" :: held 1.059s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:19 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Created reservations ['b25c664f-bcef-4566-b53c-c1c98b5c6e6f', '13d0436f-0af0-42f4-ae7b-49a97f888845', '496fb235-2a72-47f3-8208-a9bb10ee4561', 'cb8950e5-9a6a-4f0d-bb57-eafa61d61078'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:20 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:20 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:20 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.info" returned: 0 in 0.561s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:20 devstack sudo[88062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:08:20 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.208s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:20 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-2f7e01cf-6b5a-4657-941c-2c08da4441a3 tempest-VolumesSnapshotTestJSON-575949388 None] Create snapshot completed successfully Apr 21 02:08:20 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.484s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:20 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:08:20 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Deleted volume successfully. Apr 21 02:08:20 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c48fd9a5-7c0e-49d0-a03c-4e95a9076a9a tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-de1e85c5-9aa8-41ef-a0db-e331655b601f-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:20 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "cinder-36012da8-e24e-49cf-8c7a-030c1dc4eb03-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:20 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-36012da8-e24e-49cf-8c7a-030c1dc4eb03-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:20 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "cinder-quobyte-36012da8-e24e-49cf-8c7a-030c1dc4eb03" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:20 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-quobyte-36012da8-e24e-49cf-8c7a-030c1dc4eb03" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b8ac2e-9ef5-49fb-b556-0c038fbc292b]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-36012da8-e24e-49cf-8c7a-030c1dc4eb03 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-ba7122bc-c6bc-4626-b609-49658bb77427-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-ba7122bc-c6bc-4626-b609-49658bb77427-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:21 devstack sudo[88066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-36012da8-e24e-49cf-8c7a-030c1dc4eb03 Apr 21 02:08:21 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-quobyte-4b90da54-9c92-46d5-882d-ef42cbf99f61" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-4b90da54-9c92-46d5-882d-ef42cbf99f61" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-quobyte-ba7122bc-c6bc-4626-b609-49658bb77427" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-ba7122bc-c6bc-4626-b609-49658bb77427" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] Deleting offline snapshot ba7122bc-c6bc-4626-b609-49658bb77427 of volume 4b90da54-9c92-46d5-882d-ef42cbf99f61 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] snapshot_file for this snap is: volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e76a3a-3e4b-43e8-9630-9a17f05e5227]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:21 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427 Apr 21 02:08:21 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:21 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-36012da8-e24e-49cf-8c7a-030c1dc4eb03" returned: 0 in 0.512s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-36012da8-e24e-49cf-8c7a-030c1dc4eb03 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:21 devstack sudo[88073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-36012da8-e24e-49cf-8c7a-030c1dc4eb03 Apr 21 02:08:21 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:21 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427" returned: 0 in 0.589s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b90da54-9c92-46d5-882d-ef42cbf99f61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadd4d69-26e3-4674-a27b-fbb04b92a147]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:21 devstack sudo[88078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61 Apr 21 02:08:21 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:21 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-36012da8-e24e-49cf-8c7a-030c1dc4eb03" returned: 0 in 0.439s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-quobyte-36012da8-e24e-49cf-8c7a-030c1dc4eb03" released by "delete_volume" :: held 0.990s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:22 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Created reservations ['3ea63d34-8811-4c99-822c-9929a3eeb982', 'f3cf00c2-8b83-42bc-97f4-6b57c0050504', 'e456384c-103c-41a5-ba53-9a1fdc01f2ae', '7fee84a7-df36-426b-b314-7eda97cb308f'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:22 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:22 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:22 devstack sudo[88081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:08:22 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:22 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61" returned: 0 in 0.536s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:22 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427 Apr 21 02:08:22 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:22 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.501s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:22 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:08:22 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Deleted volume successfully. Apr 21 02:08:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9f2e860f-51d0-4783-a555-76e26b8caf4e tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-36012da8-e24e-49cf-8c7a-030c1dc4eb03-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:22 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427" returned: 0 in 0.449s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:22 devstack sudo[88092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427 Apr 21 02:08:22 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:23 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "cinder-279037bd-3637-40c0-8e16-5dc9776be8ba-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61.ba7122bc-c6bc-4626-b609-49658bb77427" returned: 0 in 0.420s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-279037bd-3637-40c0-8e16-5dc9776be8ba-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-ba7122bc-c6bc-4626-b609-49658bb77427" released by "_delete_snapshot" :: held 2.064s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-4b90da54-9c92-46d5-882d-ef42cbf99f61" released by "delete_snapshot" :: held 2.076s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "cinder-quobyte-279037bd-3637-40c0-8e16-5dc9776be8ba" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:23 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] Created reservations ['16e840f7-368d-4b99-9b38-438ceb00e3c1', '42ae046c-9d14-4dc3-b444-b5a87177220b', '67210423-4381-4aa1-808c-83e9830c58bb', '8bb8ce8b-c796-4208-bdeb-e45934c96f3c'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-quobyte-279037bd-3637-40c0-8e16-5dc9776be8ba" acquired by "delete_volume" :: waited 0.037s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:23 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be092d6-a509-4054-8ab0-47e1e6d09d81]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-279037bd-3637-40c0-8e16-5dc9776be8ba {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:23 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] Delete snapshot completed successfully. Apr 21 02:08:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0f61d22e-d511-4f65-a58a-240e4448e3bf tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-ba7122bc-c6bc-4626-b609-49658bb77427-delete_snapshot" released by "delete_snapshot" :: held 2.236s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:23 devstack sudo[88095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-279037bd-3637-40c0-8e16-5dc9776be8ba Apr 21 02:08:23 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:23 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b4e87c2b-9233-467d-98c6-4cc20e6e5dd4 tempest-GroupsTest-1795586686 None] Group tempest-Group1-116910689: creating Apr 21 02:08:23 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-279037bd-3637-40c0-8e16-5dc9776be8ba" returned: 0 in 0.490s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-279037bd-3637-40c0-8e16-5dc9776be8ba {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:23 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b4e87c2b-9233-467d-98c6-4cc20e6e5dd4 tempest-GroupsTest-1795586686 None] Group tempest-Group1-116910689: created successfully Apr 21 02:08:23 devstack sudo[88100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-279037bd-3637-40c0-8e16-5dc9776be8ba Apr 21 02:08:23 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:23 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b4e87c2b-9233-467d-98c6-4cc20e6e5dd4 tempest-GroupsTest-1795586686 None] Create group completed successfully. Apr 21 02:08:24 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-279037bd-3637-40c0-8e16-5dc9776be8ba" returned: 0 in 0.402s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-quobyte-279037bd-3637-40c0-8e16-5dc9776be8ba" released by "delete_volume" :: held 0.918s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Created reservations ['36b6a576-a377-4724-a025-85dbf255ce09', '6da38b96-fba0-490c-9692-7c59d4b9c958', 'b8d96b0a-a2b7-46dd-9482-201ac8168b8d', '4957504e-0a90-4343-a182-8b94e3f14cb3'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:24 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:08:24 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Flow 'volume_create_manager' (d1e87cbd-9713-4e21-bb1c-061f19f10574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0c86e3-8365-41cb-8ccd-fb57b3060315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0c86e3-8365-41cb-8ccd-fb57b3060315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1391004994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4453f0d7-a23e-484c-95e0-5d9d8f0733f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54b468c734a4158b61b488755f6d91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:25Z,use_quota=True,user_id='370b1f6cd9e2473db4e6343a1d4c963f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f37b03-d52c-44c7-8386-352437ba6324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f37b03-d52c-44c7-8386-352437ba6324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acaa50da-2552-439a-a9c3-08bc0309b75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acaa50da-2552-439a-a9c3-08bc0309b75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4453f0d7-a23e-484c-95e0-5d9d8f0733f9', 'volume_name': 'volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf28790-b795-4635-9d83-b540f0e16e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf28790-b795-4635-9d83-b540f0e16e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d76866-c1a4-42a6-a6d4-3725a16c6bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:24 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Volume 4453f0d7-a23e-484c-95e0-5d9d8f0733f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9', 'volume_size': 1} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1391004994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4453f0d7-a23e-484c-95e0-5d9d8f0733f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54b468c734a4158b61b488755f6d91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:25Z,use_quota=True,user_id='370b1f6cd9e2473db4e6343a1d4c963f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Creating volume 4453f0d7-a23e-484c-95e0-5d9d8f0733f9 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:08:24 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:24 devstack sudo[88105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 1073741824 Apr 21 02:08:24 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:24 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.467s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:08:24 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Deleted volume successfully. Apr 21 02:08:24 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3d126818-bfb3-4207-a353-f365516ab733 tempest-CreateVolumesFromSourceVolumeTest-831414786 None] Lock "cinder-279037bd-3637-40c0-8e16-5dc9776be8ba-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:24 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b4e970e7-6a56-4876-9843-99e3995f7f2f tempest-GroupsTest-1795586686 None] Group tempest-Group2-1059348548: creating Apr 21 02:08:24 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b4e970e7-6a56-4876-9843-99e3995f7f2f tempest-GroupsTest-1795586686 None] Group tempest-Group2-1059348548: created successfully Apr 21 02:08:24 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b4e970e7-6a56-4876-9843-99e3995f7f2f tempest-GroupsTest-1795586686 None] Create group completed successfully. Apr 21 02:08:25 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 1073741824" returned: 0 in 0.498s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:25 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 Apr 21 02:08:25 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:25 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9" returned: 0 in 0.427s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:08:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d76866-c1a4-42a6-a6d4-3725a16c6bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300b391b-d031-4acf-b22f-682c46633756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:25 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Volume volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 (4453f0d7-a23e-484c-95e0-5d9d8f0733f9): created successfully Apr 21 02:08:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300b391b-d031-4acf-b22f-682c46633756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Flow 'volume_create_manager' (d1e87cbd-9713-4e21-bb1c-061f19f10574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:25 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-edf59d24-b498-47b9-a651-82153d5c4ea5 tempest-VolumesSnapshotTestJSON-575949388 None] Created volume successfully. Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Flow 'volume_create_manager' (92279278-094b-4d3c-903b-dbb9edfd57db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbced3a4-3fd0-42d4-80ad-1e50e5728c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbced3a4-3fd0-42d4-80ad-1e50e5728c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1474746221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fd6e84c5-aa3b-4246-92f1-47963cfac61a,host='devstack@QuobyteHD#QuobyteHD',id=9baecf44-4143-47c3-a3b0-a2e10a59d656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8727d11e5beb45fc9ad77d0ad2c83e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:26Z,use_quota=True,user_id='d45dcda3b8184763a6f9c61b41fa7e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1aadeb5d-0dfa-4d20-a75a-f53c80c4c926),volume_type_id=1aadeb5d-0dfa-4d20-a75a-f53c80c4c926)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe412d1-c8c7-46f7-bcbb-5e00eaeb97dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe412d1-c8c7-46f7-bcbb-5e00eaeb97dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a478ad0-e1dc-4756-b16b-34b3366605d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a478ad0-e1dc-4756-b16b-34b3366605d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9baecf44-4143-47c3-a3b0-a2e10a59d656', 'volume_name': 'volume-9baecf44-4143-47c3-a3b0-a2e10a59d656', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b910de61-cf8b-48be-b0c1-ae4d8fd313c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b910de61-cf8b-48be-b0c1-ae4d8fd313c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a83887-be67-48c2-9155-5e3657a4211b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:26 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Volume 9baecf44-4143-47c3-a3b0-a2e10a59d656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9baecf44-4143-47c3-a3b0-a2e10a59d656', 'volume_size': 1} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fd6e84c5-aa3b-4246-92f1-47963cfac61a,created_at=2026-04-21T00:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1474746221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fd6e84c5-aa3b-4246-92f1-47963cfac61a,host='devstack@QuobyteHD#QuobyteHD',id=9baecf44-4143-47c3-a3b0-a2e10a59d656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8727d11e5beb45fc9ad77d0ad2c83e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:26Z,use_quota=True,user_id='d45dcda3b8184763a6f9c61b41fa7e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1aadeb5d-0dfa-4d20-a75a-f53c80c4c926),volume_type_id=1aadeb5d-0dfa-4d20-a75a-f53c80c4c926)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Creating volume 9baecf44-4143-47c3-a3b0-a2e10a59d656 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:08:26 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9baecf44-4143-47c3-a3b0-a2e10a59d656 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:26 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9baecf44-4143-47c3-a3b0-a2e10a59d656 1073741824 Apr 21 02:08:26 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:26 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9baecf44-4143-47c3-a3b0-a2e10a59d656 1073741824" returned: 0 in 0.511s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9baecf44-4143-47c3-a3b0-a2e10a59d656 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:26 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9baecf44-4143-47c3-a3b0-a2e10a59d656 Apr 21 02:08:26 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:27 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9baecf44-4143-47c3-a3b0-a2e10a59d656" returned: 0 in 0.403s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:08:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.495s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:27 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a83887-be67-48c2-9155-5e3657a4211b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9baecf44-4143-47c3-a3b0-a2e10a59d656', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:27 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a25351-dd52-4e0e-823d-02fd295ee951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] Creating offline snapshot 73798ed0-7f7b-4d4d-b502-2bad2d9130a0 of volume 4453f0d7-a23e-484c-95e0-5d9d8f0733f9 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:08:27 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Volume volume-9baecf44-4143-47c3-a3b0-a2e10a59d656 (9baecf44-4143-47c3-a3b0-a2e10a59d656): created successfully Apr 21 02:08:27 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a25351-dd52-4e0e-823d-02fd295ee951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:27 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Flow 'volume_create_manager' (92279278-094b-4d3c-903b-dbb9edfd57db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:27 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[616744ac-c074-40ab-afb1-c9fabbb55904]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:27 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-913eea6b-c308-4923-b916-adcf43e50b40 tempest-GroupsTest-1795586686 None] Created volume successfully. Apr 21 02:08:27 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 Apr 21 02:08:27 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:27 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9" returned: 0 in 0.471s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:27 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0 1G Apr 21 02:08:27 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:28 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0 1G" returned: 0 in 0.462s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:28 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0 Apr 21 02:08:28 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:28 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:28 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] Acquiring lock "cinder-quobyte-9baecf44-4143-47c3-a3b0-a2e10a59d656" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0" returned: 0 in 0.449s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:28 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0 is being set with open permissions: ugo+rw Apr 21 02:08:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:28 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] Lock "cinder-quobyte-9baecf44-4143-47c3-a3b0-a2e10a59d656" acquired by "delete_volume" :: waited 0.026s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:28 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0 Apr 21 02:08:28 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:28 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabb5bef-cd7a-4fa5-89f3-686736fd789d]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9baecf44-4143-47c3-a3b0-a2e10a59d656 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:28 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9baecf44-4143-47c3-a3b0-a2e10a59d656 Apr 21 02:08:28 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:29 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0" returned: 0 in 0.436s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:29 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.info Apr 21 02:08:29 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:29 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9baecf44-4143-47c3-a3b0-a2e10a59d656" returned: 0 in 0.475s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9baecf44-4143-47c3-a3b0-a2e10a59d656 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:29 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9baecf44-4143-47c3-a3b0-a2e10a59d656 Apr 21 02:08:29 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:29 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.info" returned: 0 in 0.408s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:29 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.info is being set with open permissions: ugo+rw Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:29 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.info Apr 21 02:08:29 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:29 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9baecf44-4143-47c3-a3b0-a2e10a59d656" returned: 0 in 0.405s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] Lock "cinder-quobyte-9baecf44-4143-47c3-a3b0-a2e10a59d656" released by "delete_volume" :: held 0.901s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] Created reservations ['3dfcb2f5-cb13-49fe-9d12-c9a7b8343c53'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:29 devstack cinder-volume[82184]: WARNING cinder.quota [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1588180521 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1588180521, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:08:29 devstack cinder-volume[82184]: WARNING cinder.quota [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1588180521 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1588180521, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] Created reservations ['49747987-c3d2-440f-b842-23f817371434', '9d47a3c8-6e43-4413-ba47-abcad5e42035', '9164f027-c6ad-4f4b-a30f-d5f4edd00cf8', '7ee35ea0-76b5-4551-bb0c-a7e6ef3f53e3'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:29 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:08:29 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-f19efbde-10b7-46e2-ab62-aacb1ef9659a tempest-GroupsTest-1795586686 None] Created reservations ['9b505cce-6236-4a19-8af3-29c8f885d790'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f19efbde-10b7-46e2-ab62-aacb1ef9659a tempest-GroupsTest-1795586686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f19efbde-10b7-46e2-ab62-aacb1ef9659a tempest-GroupsTest-1795586686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f19efbde-10b7-46e2-ab62-aacb1ef9659a tempest-GroupsTest-1795586686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f19efbde-10b7-46e2-ab62-aacb1ef9659a tempest-GroupsTest-1795586686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f19efbde-10b7-46e2-ab62-aacb1ef9659a tempest-GroupsTest-1795586686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f19efbde-10b7-46e2-ab62-aacb1ef9659a tempest-GroupsTest-1795586686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:29 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:08:29 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:30 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.info" returned: 0 in 0.457s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.771s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:30 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-c27f98fe-0587-48e1-87c6-6c76e63a318b tempest-VolumesSnapshotTestJSON-575949388 None] Create snapshot completed successfully Apr 21 02:08:30 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.444s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:30 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:08:30 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-22929725-2e6c-4be1-8bdd-1642b910052f tempest-GroupsTest-1795586686 None] Delete group completed successfully. Apr 21 02:08:30 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f19efbde-10b7-46e2-ab62-aacb1ef9659a tempest-GroupsTest-1795586686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.430s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:30 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-f19efbde-10b7-46e2-ab62-aacb1ef9659a tempest-GroupsTest-1795586686 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:08:30 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-f19efbde-10b7-46e2-ab62-aacb1ef9659a tempest-GroupsTest-1795586686 None] Delete group completed successfully. Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Flow 'volume_create_manager' (73b54ff8-6c5e-4930-a3d1-cc48d7610c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec213336-9640-4c92-810c-a05ae23879c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec213336-9640-4c92-810c-a05ae23879c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1805527336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2287b58-e8cd-41fd-a869-4bd90c41f87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54b468c734a4158b61b488755f6d91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=73798ed0-7f7b-4d4d-b502-2bad2d9130a0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:31Z,use_quota=True,user_id='370b1f6cd9e2473db4e6343a1d4c963f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b697b5e9-61b2-427c-afdf-cfcecde8af8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b697b5e9-61b2-427c-afdf-cfcecde8af8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee1fcf7-85ba-4eb7-8999-a177ab217484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee1fcf7-85ba-4eb7-8999-a177ab217484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c2287b58-e8cd-41fd-a869-4bd90c41f87f', 'volume_name': 'volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f', 'volume_size': 2, 'snapshot_id': '73798ed0-7f7b-4d4d-b502-2bad2d9130a0'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcce5c0d-cf8d-45e5-997f-5583396fa497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcce5c0d-cf8d-45e5-997f-5583396fa497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ca848b-1f57-4243-a48b-2dcbbdef459d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:31 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Volume c2287b58-e8cd-41fd-a869-4bd90c41f87f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f', 'volume_size': 2, 'snapshot_id': '73798ed0-7f7b-4d4d-b502-2bad2d9130a0'} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-quobyte-73798ed0-7f7b-4d4d-b502-2bad2d9130a0-c2287b58-e8cd-41fd-a869-4bd90c41f87f" by "_create_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-73798ed0-7f7b-4d4d-b502-2bad2d9130a0-c2287b58-e8cd-41fd-a869-4bd90c41f87f" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Creating volume c2287b58-e8cd-41fd-a869-4bd90c41f87f from snapshot 73798ed0-7f7b-4d4d-b502-2bad2d9130a0 {{(pid=82184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-quobyte-c2287b58-e8cd-41fd-a869-4bd90c41f87f" by "_copy_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-c2287b58-e8cd-41fd-a869-4bd90c41f87f" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] snapshot: 73798ed0-7f7b-4d4d-b502-2bad2d9130a0, volume: c2287b58-e8cd-41fd-a869-4bd90c41f87f, {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[00884375-b3d5-45a0-86e5-1619b38aba88]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:31 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-9388de44-a2e6-4363-9dc5-5c3557735fe2 tempest-GroupsTest-1795586686 None] Group tempest-GroupsTest-Group-1623381366: creating Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:31 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-9388de44-a2e6-4363-9dc5-5c3557735fe2 tempest-GroupsTest-1795586686 None] Group tempest-GroupsTest-Group-1623381366: created successfully Apr 21 02:08:31 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-9388de44-a2e6-4363-9dc5-5c3557735fe2 tempest-GroupsTest-1795586686 None] Create group completed successfully. Apr 21 02:08:31 devstack sudo[88161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0 Apr 21 02:08:31 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:31 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0" returned: 0 in 0.465s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Creating direct copy from snapshot {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae7198f-2c01-4daf-817a-5cfb31ec5bff]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:31 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 Apr 21 02:08:31 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:32 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9" returned: 0 in 0.474s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:32 devstack cinder-volume[82184]: DEBUG cinder.utils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Path /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f not found in is_blk_device check {{(pid=82184) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 02:08:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:32 devstack sudo[88171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f Apr 21 02:08:32 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:32 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:08:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Flow 'volume_create_manager' (4d997780-6873-4555-ae70-4b5952487ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a07265-d7d4-4a08-b911-52491582aac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a07265-d7d4-4a08-b911-52491582aac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-992761003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=034578d3-28a6-4875-bc9b-629b8be42e46,host='devstack@QuobyteHD#QuobyteHD',id=79d0a5f1-33eb-489a-b1d0-0435976aaa43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8727d11e5beb45fc9ad77d0ad2c83e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:33Z,use_quota=True,user_id='d45dcda3b8184763a6f9c61b41fa7e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d1f3c96-a943-4512-ab8a-310f40d4569c),volume_type_id=6d1f3c96-a943-4512-ab8a-310f40d4569c)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b11a19-454b-4340-8e91-6aca4aaee76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b11a19-454b-4340-8e91-6aca4aaee76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6bb4d9-51d6-48db-a715-d82979c1effa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6bb4d9-51d6-48db-a715-d82979c1effa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79d0a5f1-33eb-489a-b1d0-0435976aaa43', 'volume_name': 'volume-79d0a5f1-33eb-489a-b1d0-0435976aaa43', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b155ba8-03df-4dfd-bf89-91d4b9007e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b155ba8-03df-4dfd-bf89-91d4b9007e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36dff5e-7eb7-4b89-bba6-5fdcff33f27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:32 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Volume 79d0a5f1-33eb-489a-b1d0-0435976aaa43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79d0a5f1-33eb-489a-b1d0-0435976aaa43', 'volume_size': 1} Apr 21 02:08:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:34 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f" returned: 0 in 1.937s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:34 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aab7df1-8601-4920-b249-bceee0ca6c21]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:34 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 Apr 21 02:08:34 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:34 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9" returned: 0 in 0.585s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:34 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Image conversion details: src /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9, size 1024.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:08:34 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Converted 1024.00 MB image at 528.27 MB/s Apr 21 02:08:34 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f is being set with open permissions: ugo+rw Apr 21 02:08:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:34 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f Apr 21 02:08:34 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:35 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f" returned: 0 in 0.417s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-c2287b58-e8cd-41fd-a869-4bd90c41f87f" released by "_copy_volume_from_snapshot" :: held 3.941s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-73798ed0-7f7b-4d4d-b502-2bad2d9130a0-c2287b58-e8cd-41fd-a869-4bd90c41f87f" released by "_create_volume_from_snapshot" :: held 3.957s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.967s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.584s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=034578d3-28a6-4875-bc9b-629b8be42e46,created_at=2026-04-21T00:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-992761003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=034578d3-28a6-4875-bc9b-629b8be42e46,host='devstack@QuobyteHD#QuobyteHD',id=79d0a5f1-33eb-489a-b1d0-0435976aaa43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8727d11e5beb45fc9ad77d0ad2c83e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:33Z,use_quota=True,user_id='d45dcda3b8184763a6f9c61b41fa7e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d1f3c96-a943-4512-ab8a-310f40d4569c),volume_type_id=6d1f3c96-a943-4512-ab8a-310f40d4569c)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Creating volume 79d0a5f1-33eb-489a-b1d0-0435976aaa43 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:08:35 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-79d0a5f1-33eb-489a-b1d0-0435976aaa43 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:35 devstack sudo[88193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-79d0a5f1-33eb-489a-b1d0-0435976aaa43 1073741824 Apr 21 02:08:35 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ca848b-1f57-4243-a48b-2dcbbdef459d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f', 'volume_size': 2, 'snapshot_id': '73798ed0-7f7b-4d4d-b502-2bad2d9130a0'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (374cf067-c91c-432d-9342-e145f524b2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:35 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Volume volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f (c2287b58-e8cd-41fd-a869-4bd90c41f87f): created successfully Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (374cf067-c91c-432d-9342-e145f524b2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Flow 'volume_create_manager' (73b54ff8-6c5e-4930-a3d1-cc48d7610c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:35 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-cbddcada-7c37-4c40-860c-574fe84dbe37 tempest-VolumesSnapshotTestJSON-575949388 None] Created volume successfully. Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-c2287b58-e8cd-41fd-a869-4bd90c41f87f-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-c2287b58-e8cd-41fd-a869-4bd90c41f87f-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-quobyte-c2287b58-e8cd-41fd-a869-4bd90c41f87f" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-c2287b58-e8cd-41fd-a869-4bd90c41f87f" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba45e3eb-e5f0-4a2f-b405-0c28f05cc75e]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:35 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f Apr 21 02:08:35 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:35 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-79d0a5f1-33eb-489a-b1d0-0435976aaa43 1073741824" returned: 0 in 0.488s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-79d0a5f1-33eb-489a-b1d0-0435976aaa43 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:35 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-79d0a5f1-33eb-489a-b1d0-0435976aaa43 Apr 21 02:08:35 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:35 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f" returned: 0 in 0.478s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:35 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f Apr 21 02:08:35 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:36 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-79d0a5f1-33eb-489a-b1d0-0435976aaa43" returned: 0 in 0.435s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36dff5e-7eb7-4b89-bba6-5fdcff33f27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d0a5f1-33eb-489a-b1d0-0435976aaa43', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc3a3e3-e40f-4c9c-a83a-e2b8a22ceddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:36 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Volume volume-79d0a5f1-33eb-489a-b1d0-0435976aaa43 (79d0a5f1-33eb-489a-b1d0-0435976aaa43): created successfully Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc3a3e3-e40f-4c9c-a83a-e2b8a22ceddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Flow 'volume_create_manager' (4d997780-6873-4555-ae70-4b5952487ba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:36 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b859d215-5bc5-4381-84d2-72892b4ca21c tempest-GroupsTest-1795586686 None] Created volume successfully. Apr 21 02:08:36 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c2287b58-e8cd-41fd-a869-4bd90c41f87f" returned: 0 in 0.431s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-c2287b58-e8cd-41fd-a869-4bd90c41f87f" released by "delete_volume" :: held 0.933s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] Created reservations ['16deeff6-b805-4235-b029-c8cbfa639fb2', 'e5929945-c0dd-4d22-8a31-55f5f7c69e7c', '3bff551b-ac74-49b0-bead-4f689efd36d8', 'f369d38a-bc38-41c3-a295-db499f09a2d7'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:36 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:08:36 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-73798ed0-7f7b-4d4d-b502-2bad2d9130a0-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-73798ed0-7f7b-4d4d-b502-2bad2d9130a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-quobyte-4453f0d7-a23e-484c-95e0-5d9d8f0733f9" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-4453f0d7-a23e-484c-95e0-5d9d8f0733f9" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-quobyte-73798ed0-7f7b-4d4d-b502-2bad2d9130a0" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-73798ed0-7f7b-4d4d-b502-2bad2d9130a0" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] Deleting offline snapshot 73798ed0-7f7b-4d4d-b502-2bad2d9130a0 of volume 4453f0d7-a23e-484c-95e0-5d9d8f0733f9 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] snapshot_file for this snap is: volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[787b9600-4ddf-4a97-8320-cef68fb031e8]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:36 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0 Apr 21 02:08:36 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:36 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.418s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:08:36 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] Deleted volume successfully. Apr 21 02:08:36 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-412fb8e9-2f00-498d-b4b3-f38c30bbf257 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-c2287b58-e8cd-41fd-a869-4bd90c41f87f-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:37 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0" returned: 0 in 0.488s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dd3e0e-2c54-46fe-adc7-76d51e181b27]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:37 devstack sudo[88217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 Apr 21 02:08:37 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Flow 'volume_create_manager' (61799d2f-a671-4ee0-a032-69c40505da9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68eb9ea3-0fd5-42b0-91a9-1e5cb0666212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68eb9ea3-0fd5-42b0-91a9-1e5cb0666212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-158893053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=034578d3-28a6-4875-bc9b-629b8be42e46,host='devstack@QuobyteHD#QuobyteHD',id=5f3354bd-b456-411f-b442-06b0d182d16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8727d11e5beb45fc9ad77d0ad2c83e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:37Z,use_quota=True,user_id='d45dcda3b8184763a6f9c61b41fa7e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d1f3c96-a943-4512-ab8a-310f40d4569c),volume_type_id=6d1f3c96-a943-4512-ab8a-310f40d4569c)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d8b300-a45c-45a3-857b-52846a292c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d8b300-a45c-45a3-857b-52846a292c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1516e31-655a-4add-a40d-26a932a7d933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1516e31-655a-4add-a40d-26a932a7d933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f3354bd-b456-411f-b442-06b0d182d16f', 'volume_name': 'volume-5f3354bd-b456-411f-b442-06b0d182d16f', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae1bd37-2463-42e5-b566-841a465fd0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae1bd37-2463-42e5-b566-841a465fd0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ddf727e-c1b6-4742-9204-564001d507bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:37 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Volume 5f3354bd-b456-411f-b442-06b0d182d16f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f3354bd-b456-411f-b442-06b0d182d16f', 'volume_size': 1} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=034578d3-28a6-4875-bc9b-629b8be42e46,created_at=2026-04-21T00:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-158893053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=034578d3-28a6-4875-bc9b-629b8be42e46,host='devstack@QuobyteHD#QuobyteHD',id=5f3354bd-b456-411f-b442-06b0d182d16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8727d11e5beb45fc9ad77d0ad2c83e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:37Z,use_quota=True,user_id='d45dcda3b8184763a6f9c61b41fa7e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d1f3c96-a943-4512-ab8a-310f40d4569c),volume_type_id=6d1f3c96-a943-4512-ab8a-310f40d4569c)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Creating volume 5f3354bd-b456-411f-b442-06b0d182d16f {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:08:37 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5f3354bd-b456-411f-b442-06b0d182d16f 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:37 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5f3354bd-b456-411f-b442-06b0d182d16f 1073741824 Apr 21 02:08:37 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:37 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9" returned: 0 in 0.495s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:37 devstack sudo[88224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0 Apr 21 02:08:37 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:37 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5f3354bd-b456-411f-b442-06b0d182d16f 1073741824" returned: 0 in 0.480s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5f3354bd-b456-411f-b442-06b0d182d16f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:38 devstack sudo[88232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5f3354bd-b456-411f-b442-06b0d182d16f Apr 21 02:08:38 devstack sudo[88232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:38 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0" returned: 0 in 0.462s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:38 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0 Apr 21 02:08:38 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:38 devstack sudo[88232]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5f3354bd-b456-411f-b442-06b0d182d16f" returned: 0 in 0.401s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ddf727e-c1b6-4742-9204-564001d507bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f3354bd-b456-411f-b442-06b0d182d16f', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e17e4e-5cdb-48bb-8b51-c86668afa468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:38 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Volume volume-5f3354bd-b456-411f-b442-06b0d182d16f (5f3354bd-b456-411f-b442-06b0d182d16f): created successfully Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e17e4e-5cdb-48bb-8b51-c86668afa468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Flow 'volume_create_manager' (61799d2f-a671-4ee0-a032-69c40505da9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:38 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-4b8b7b62-24b1-4f43-9541-cc593a48bea5 tempest-GroupsTest-1795586686 None] Created volume successfully. Apr 21 02:08:38 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9.73798ed0-7f7b-4d4d-b502-2bad2d9130a0" returned: 0 in 0.417s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-73798ed0-7f7b-4d4d-b502-2bad2d9130a0" released by "_delete_snapshot" :: held 1.911s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-4453f0d7-a23e-484c-95e0-5d9d8f0733f9" released by "delete_snapshot" :: held 1.922s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] Created reservations ['f025eb3c-2a28-4130-8f7b-65a4ad03d5b2', '316e710b-7d07-4165-9d02-a567bcb20d4c', '2746716b-ea46-4b07-84f7-34163aca6efd', '00725ee0-cf9a-4e34-9afd-c41059e81930'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:38 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] Delete snapshot completed successfully. Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4d48a588-df74-4b46-a7e5-02ca84c3f4ea tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-73798ed0-7f7b-4d4d-b502-2bad2d9130a0-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG oslo_service.periodic_task [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-4453f0d7-a23e-484c-95e0-5d9d8f0733f9-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-4453f0d7-a23e-484c-95e0-5d9d8f0733f9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:38 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:08:38 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-quobyte-4453f0d7-a23e-484c-95e0-5d9d8f0733f9" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-4453f0d7-a23e-484c-95e0-5d9d8f0733f9" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34496c8-b783-477c-8a45-dcb24059e60c]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:38 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 Apr 21 02:08:38 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:39 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.428s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:39 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:08:39 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9" returned: 0 in 0.501s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:39 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9 Apr 21 02:08:39 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:39 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-cb817f36-1b05-423c-af61-bb890f10941d tempest-GroupsTest-1795586686 None] Update group completed successfully. Apr 21 02:08:39 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4453f0d7-a23e-484c-95e0-5d9d8f0733f9" returned: 0 in 0.435s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:39 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-4453f0d7-a23e-484c-95e0-5d9d8f0733f9" released by "delete_volume" :: held 0.960s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:39 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] Created reservations ['7afdfccb-ec0d-4ed8-85cf-ecfc799c5680', '669a2f9f-6a73-4757-85c2-20bc83da8ecd', '7b244afd-66b2-493e-95b7-3aecbe74abd3', '8a1edcfb-6054-4983-920c-2a3c9fd844f6'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:39 devstack sudo[88249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:08:39 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:40 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.407s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:40 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:08:40 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] Deleted volume successfully. Apr 21 02:08:40 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-140ece70-08bf-4143-8bfb-3a8cd52bf79c tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-4453f0d7-a23e-484c-95e0-5d9d8f0733f9-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:40 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-a3e6b889-84ed-458b-8fbb-c2a1c8424185 tempest-GroupsTest-1795586686 None] Update group completed successfully. Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Flow 'volume_create_manager' (93805ac4-30b4-4c7d-9de1-6c7064d44b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a668ed-e676-4ce8-bd35-0efe22e904b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a668ed-e676-4ce8-bd35-0efe22e904b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1441462958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54b468c734a4158b61b488755f6d91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:41Z,use_quota=True,user_id='370b1f6cd9e2473db4e6343a1d4c963f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8331c2-37ad-4d92-a60a-c7888face688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8331c2-37ad-4d92-a60a-c7888face688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5306d4c6-b6dc-4d0f-8561-b987dac70e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5306d4c6-b6dc-4d0f-8561-b987dac70e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3', 'volume_name': 'volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c49fc74-9e38-4ffb-85a5-11ac65ac6f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c49fc74-9e38-4ffb-85a5-11ac65ac6f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae081e30-a343-498b-85c7-a91e5e485bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:41 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Volume 87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3', 'volume_size': 1} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1441462958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54b468c734a4158b61b488755f6d91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:41Z,use_quota=True,user_id='370b1f6cd9e2473db4e6343a1d4c963f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Creating volume 87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:08:41 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:41 devstack sudo[88252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 1073741824 Apr 21 02:08:41 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:41 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 1073741824" returned: 0 in 0.461s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:41 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 Apr 21 02:08:41 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Acquiring lock "cinder-quobyte-5f3354bd-b456-411f-b442-06b0d182d16f" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Lock "cinder-quobyte-5f3354bd-b456-411f-b442-06b0d182d16f" acquired by "delete_volume" :: waited 0.017s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:42 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3" returned: 0 in 0.442s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:08:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:42 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f943a34-195c-4439-ba13-5a92c5f9b85f]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5f3354bd-b456-411f-b442-06b0d182d16f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae081e30-a343-498b-85c7-a91e5e485bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73771fcf-3ba7-45f6-8d64-0239046e4526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:42 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Volume volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 (87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3): created successfully Apr 21 02:08:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73771fcf-3ba7-45f6-8d64-0239046e4526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Flow 'volume_create_manager' (93805ac4-30b4-4c7d-9de1-6c7064d44b3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:42 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-f011e24e-6569-4a10-86f9-8b391aac12bf tempest-VolumesSnapshotTestJSON-575949388 None] Created volume successfully. Apr 21 02:08:42 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5f3354bd-b456-411f-b442-06b0d182d16f Apr 21 02:08:42 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:42 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5f3354bd-b456-411f-b442-06b0d182d16f" returned: 0 in 0.469s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5f3354bd-b456-411f-b442-06b0d182d16f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:42 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5f3354bd-b456-411f-b442-06b0d182d16f Apr 21 02:08:42 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:43 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5f3354bd-b456-411f-b442-06b0d182d16f" returned: 0 in 0.406s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Lock "cinder-quobyte-5f3354bd-b456-411f-b442-06b0d182d16f" released by "delete_volume" :: held 0.903s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Acquiring lock "cinder-quobyte-79d0a5f1-33eb-489a-b1d0-0435976aaa43" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Lock "cinder-quobyte-79d0a5f1-33eb-489a-b1d0-0435976aaa43" acquired by "delete_volume" :: waited 0.005s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:43 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1710c7-c34b-4e9b-a051-6e7ff6241b76]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-79d0a5f1-33eb-489a-b1d0-0435976aaa43 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:43 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-79d0a5f1-33eb-489a-b1d0-0435976aaa43 Apr 21 02:08:43 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] Creating offline snapshot ade5d2eb-5539-4bf3-89a4-18c03137d7ea of volume 87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:08:43 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cfc6c6-866e-4edf-9eaa-44da70898a51]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:43 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 Apr 21 02:08:43 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:43 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-79d0a5f1-33eb-489a-b1d0-0435976aaa43" returned: 0 in 0.490s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-79d0a5f1-33eb-489a-b1d0-0435976aaa43 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:43 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-79d0a5f1-33eb-489a-b1d0-0435976aaa43 Apr 21 02:08:43 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:43 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3" returned: 0 in 0.468s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:43 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea 1G Apr 21 02:08:43 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:43 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-79d0a5f1-33eb-489a-b1d0-0435976aaa43" returned: 0 in 0.410s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Lock "cinder-quobyte-79d0a5f1-33eb-489a-b1d0-0435976aaa43" released by "delete_volume" :: held 0.920s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:43 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Created reservations ['7ba0b4ff-67b5-49cb-be73-1ee8460145ab'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:44 devstack cinder-volume[82184]: WARNING cinder.quota [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1777009437 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1777009437, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:08:44 devstack cinder-volume[82184]: WARNING cinder.quota [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1777009437 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1777009437, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:08:44 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Created reservations ['4ccf891a-5af6-4c7c-a8f1-0e644f3d0687', '1cc73d74-3a0b-4647-98c8-adf9c9d9918b', '63c7421c-f7df-4473-baad-728e14651d41', 'ab9e0e63-3fe8-417d-b4f0-9807953ab623'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:44 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Created reservations ['4688b8da-13d3-4bf7-a30c-80a9e0b57035', '7be8571a-cd14-4e75-8dc7-c0e447f8c036', 'd99d6383-90dd-4ea5-bd61-6d5e5033ba54', 'f9297223-a73d-46a2-a437-7524b6fc4e64'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:44 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:44 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:44 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:08:44 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:44 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea 1G" returned: 0 in 0.531s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:44 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea Apr 21 02:08:44 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:44 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.522s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:44 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:08:44 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-abddd573-fec9-43b4-8cc4-54da7c73067f tempest-GroupsTest-1795586686 None] Delete group completed successfully. Apr 21 02:08:44 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea" returned: 0 in 0.475s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:44 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea is being set with open permissions: ugo+rw Apr 21 02:08:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:44 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea Apr 21 02:08:44 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:45 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea" returned: 0 in 0.463s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:45 devstack sudo[88301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.info Apr 21 02:08:45 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:45 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.info" returned: 0 in 0.443s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:45 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.info is being set with open permissions: ugo+rw Apr 21 02:08:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:45 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.info Apr 21 02:08:45 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:46 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.info" returned: 0 in 0.434s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.866s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:46 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-5af5d8a6-e84a-447d-9ef5-76549bde07a3 tempest-VolumesSnapshotTestJSON-575949388 None] Create snapshot completed successfully Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Flow 'volume_create_manager' (e1388097-2617-40be-9ca1-edce704969de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3548fced-43d2-4c01-aab2-814b615a4d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3548fced-43d2-4c01-aab2-814b615a4d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2029967143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f006b3e-7a56-4e17-a3c4-56ff5fcab47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54b468c734a4158b61b488755f6d91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ade5d2eb-5539-4bf3-89a4-18c03137d7ea,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:47Z,use_quota=True,user_id='370b1f6cd9e2473db4e6343a1d4c963f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15066049-17ab-4a35-aa2e-8bc652b80f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15066049-17ab-4a35-aa2e-8bc652b80f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273681b9-e270-4ee1-ae88-dd3a51801001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273681b9-e270-4ee1-ae88-dd3a51801001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1f006b3e-7a56-4e17-a3c4-56ff5fcab47f', 'volume_name': 'volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f', 'volume_size': 1, 'snapshot_id': 'ade5d2eb-5539-4bf3-89a4-18c03137d7ea'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c982f4-ac9f-4a79-9dda-d289336a42f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c982f4-ac9f-4a79-9dda-d289336a42f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (150ac2b4-2cf9-4dcc-ba05-d2e85a7e27fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:46 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Volume 1f006b3e-7a56-4e17-a3c4-56ff5fcab47f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f', 'volume_size': 1, 'snapshot_id': 'ade5d2eb-5539-4bf3-89a4-18c03137d7ea'} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-quobyte-ade5d2eb-5539-4bf3-89a4-18c03137d7ea-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f" by "_create_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-ade5d2eb-5539-4bf3-89a4-18c03137d7ea-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Creating volume 1f006b3e-7a56-4e17-a3c4-56ff5fcab47f from snapshot ade5d2eb-5539-4bf3-89a4-18c03137d7ea {{(pid=82184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-quobyte-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f" by "_copy_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] snapshot: ade5d2eb-5539-4bf3-89a4-18c03137d7ea, volume: 1f006b3e-7a56-4e17-a3c4-56ff5fcab47f, {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d7eae0-c2b0-4de0-8727-f29f0a36d99c]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:47 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea Apr 21 02:08:47 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:47 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-f92112ef-308f-48d7-a66b-5d5d11922937 tempest-GroupsV314Test-909414691 None] Group tempest-GroupsV314Test-Group-1128355570: creating Apr 21 02:08:47 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-f92112ef-308f-48d7-a66b-5d5d11922937 tempest-GroupsV314Test-909414691 None] Group tempest-GroupsV314Test-Group-1128355570: created successfully Apr 21 02:08:47 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-f92112ef-308f-48d7-a66b-5d5d11922937 tempest-GroupsV314Test-909414691 None] Create group completed successfully. Apr 21 02:08:47 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea" returned: 0 in 0.523s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:08:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 02:08:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Creating direct copy from snapshot {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 02:08:47 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f504f9-2462-445f-8706-b1b997d6b053]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:47 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 Apr 21 02:08:47 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:47 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3" returned: 0 in 0.455s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:47 devstack cinder-volume[82184]: DEBUG cinder.utils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Path /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f not found in is_blk_device check {{(pid=82184) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 02:08:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:47 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f Apr 21 02:08:47 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:48 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:08:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Flow 'volume_create_manager' (137a0640-ade8-43a9-a148-d25b23aaf6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f49e95-e401-4889-9b68-245c16dc0948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f49e95-e401-4889-9b68-245c16dc0948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-381637990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=954fb4e5-7888-42ec-9ac1-73a62972177e,host='devstack@QuobyteHD#QuobyteHD',id=8b04b912-c764-4055-b0d9-fb033d3cf872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fba6f5f1dd7485ebd776476cac8b72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:49Z,use_quota=True,user_id='d2a87936bb2641978ed1320cd9526e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8f002b5-866a-4c34-a253-07d9893ef398),volume_type_id=a8f002b5-866a-4c34-a253-07d9893ef398)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2f767a-8f0b-491d-9ec2-4481a6240b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2f767a-8f0b-491d-9ec2-4481a6240b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e507af54-fc9a-4486-b5bb-780c96f95f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e507af54-fc9a-4486-b5bb-780c96f95f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b04b912-c764-4055-b0d9-fb033d3cf872', 'volume_name': 'volume-8b04b912-c764-4055-b0d9-fb033d3cf872', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9b5795-1bdd-45be-87e4-dc53ce69b35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9b5795-1bdd-45be-87e4-dc53ce69b35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:49 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe48142-b02b-489a-b028-1bc241e13d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:49 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Volume 8b04b912-c764-4055-b0d9-fb033d3cf872: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b04b912-c764-4055-b0d9-fb033d3cf872', 'volume_size': 1} Apr 21 02:08:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:49 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f" returned: 0 in 2.030s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:49 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a4f7c0-2c32-4532-957a-789e6954b200]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:50 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 Apr 21 02:08:50 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:50 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3" returned: 0 in 0.604s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:50 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Image conversion details: src /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:08:50 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Converted 1024.00 MB image at 503.59 MB/s Apr 21 02:08:50 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f is being set with open permissions: ugo+rw Apr 21 02:08:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:50 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f Apr 21 02:08:50 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:50 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f" returned: 0 in 0.398s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:50 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f" released by "_copy_volume_from_snapshot" :: held 4.067s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:50 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-ade5d2eb-5539-4bf3-89a4-18c03137d7ea-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f" released by "_create_volume_from_snapshot" :: held 4.091s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.099s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.727s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=954fb4e5-7888-42ec-9ac1-73a62972177e,created_at=2026-04-21T00:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-381637990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=954fb4e5-7888-42ec-9ac1-73a62972177e,host='devstack@QuobyteHD#QuobyteHD',id=8b04b912-c764-4055-b0d9-fb033d3cf872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fba6f5f1dd7485ebd776476cac8b72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:08:49Z,use_quota=True,user_id='d2a87936bb2641978ed1320cd9526e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8f002b5-866a-4c34-a253-07d9893ef398),volume_type_id=a8f002b5-866a-4c34-a253-07d9893ef398)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Creating volume 8b04b912-c764-4055-b0d9-fb033d3cf872 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:08:51 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:51 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 1073741824 Apr 21 02:08:51 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (150ac2b4-2cf9-4dcc-ba05-d2e85a7e27fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f', 'volume_size': 1, 'snapshot_id': 'ade5d2eb-5539-4bf3-89a4-18c03137d7ea'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14efb573-96ba-467a-a127-73fb808c7d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:51 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Volume volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f (1f006b3e-7a56-4e17-a3c4-56ff5fcab47f): created successfully Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14efb573-96ba-467a-a127-73fb808c7d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Flow 'volume_create_manager' (e1388097-2617-40be-9ca1-edce704969de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:51 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-9a625e36-760f-4cb9-b1cf-ac3c1847b2eb tempest-VolumesSnapshotTestJSON-575949388 None] Created volume successfully. Apr 21 02:08:51 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 1073741824" returned: 0 in 0.479s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:51 devstack sudo[88382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 Apr 21 02:08:51 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:51 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872" returned: 0 in 0.405s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe48142-b02b-489a-b028-1bc241e13d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b04b912-c764-4055-b0d9-fb033d3cf872', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f68fe1-8edc-41de-b01b-e120733bbc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:08:51 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Volume volume-8b04b912-c764-4055-b0d9-fb033d3cf872 (8b04b912-c764-4055-b0d9-fb033d3cf872): created successfully Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f68fe1-8edc-41de-b01b-e120733bbc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:08:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Flow 'volume_create_manager' (137a0640-ade8-43a9-a148-d25b23aaf6d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:08:51 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-df43a0e8-8deb-431e-9dc7-f0334db9acc6 tempest-GroupsV314Test-909414691 None] Created volume successfully. Apr 21 02:08:52 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:52 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:52 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-quobyte-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:52 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:52 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[226d3b88-9c28-475d-a493-e13123197f9a]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:52 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f Apr 21 02:08:52 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:52 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f" returned: 0 in 0.467s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:52 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f Apr 21 02:08:52 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:53 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Cloning volume 8b04b912-c764-4055-b0d9-fb033d3cf872 to volume 063d2b79-25ae-4e2d-865b-145e0bace6aa Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Creating offline snapshot 09c611e1-c538-4e9d-987b-bbc28e29a47d of volume 8b04b912-c764-4055-b0d9-fb033d3cf872 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[709adac0-d552-4728-9ee7-9d901c657ff1]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:53 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 Apr 21 02:08:53 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:53 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f" returned: 0 in 0.436s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f" released by "delete_volume" :: held 0.935s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] Created reservations ['86e11334-ba81-4b43-b70b-aecc63add541', 'a1caa053-1763-4268-8235-91c9811700ab', '8a3fa49b-54f7-4a33-9c64-6a202316da0f', '5f72f6ef-bf69-45ca-b63a-a9ff0f0e2551'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:53 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:08:53 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-ade5d2eb-5539-4bf3-89a4-18c03137d7ea-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-ade5d2eb-5539-4bf3-89a4-18c03137d7ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-quobyte-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-quobyte-ade5d2eb-5539-4bf3-89a4-18c03137d7ea" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-ade5d2eb-5539-4bf3-89a4-18c03137d7ea" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] Deleting offline snapshot ade5d2eb-5539-4bf3-89a4-18c03137d7ea of volume 87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] snapshot_file for this snap is: volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ffcffa-d8d6-424f-8276-59c086b6e24e]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:53 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea Apr 21 02:08:53 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:53 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872" returned: 0 in 0.535s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:53 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d 1G Apr 21 02:08:53 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:53 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.427s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:08:53 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] Deleted volume successfully. Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d33acbbd-fe05-4710-893f-6180d46941c2 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-1f006b3e-7a56-4e17-a3c4-56ff5fcab47f-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:53 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea" returned: 0 in 0.491s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f25e76c-5dbc-4375-9902-358094ab6d77]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:53 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 Apr 21 02:08:53 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:54 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d 1G" returned: 0 in 0.493s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b04b912-c764-4055-b0d9-fb033d3cf872 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:54 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b04b912-c764-4055-b0d9-fb033d3cf872 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d Apr 21 02:08:54 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:54 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3" returned: 0 in 0.480s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:54 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea Apr 21 02:08:54 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:54 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b04b912-c764-4055-b0d9-fb033d3cf872 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d" returned: 0 in 0.437s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:54 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d is being set with open permissions: ugo+rw: NotImplementedError Apr 21 02:08:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:54 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d Apr 21 02:08:54 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:54 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea" returned: 0 in 0.469s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:54 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea Apr 21 02:08:54 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:54 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d" returned: 0 in 0.446s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:55 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.info Apr 21 02:08:55 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:55 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3.ade5d2eb-5539-4bf3-89a4-18c03137d7ea" returned: 0 in 0.421s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-ade5d2eb-5539-4bf3-89a4-18c03137d7ea" released by "_delete_snapshot" :: held 1.917s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3" released by "delete_snapshot" :: held 1.930s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] Created reservations ['01e04e56-14b9-44f7-84e9-b4d2a2b1c409', 'd08ec96c-df29-468a-b9c3-d635624ec1db', 'e0795c61-dba4-4ee8-b1bb-1820d6370284', '85ddbfdd-72a2-433e-a404-b89a17f03bac'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:55 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] Delete snapshot completed successfully. Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-29dac942-7584-48c1-9d65-339cc36bd4e3 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-ade5d2eb-5539-4bf3-89a4-18c03137d7ea-delete_snapshot" released by "delete_snapshot" :: held 2.021s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:55 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.info" returned: 0 in 0.435s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:55 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:55 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.info Apr 21 02:08:55 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-quobyte-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3" acquired by "delete_volume" :: waited 0.017s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[62215b44-981f-4a59-b695-3c478bb15cba]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:55 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 Apr 21 02:08:55 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:55 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.info" returned: 0 in 0.414s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Acquiring lock "cinder-quobyte-063d2b79-25ae-4e2d-865b-145e0bace6aa" by "_copy_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Lock "cinder-quobyte-063d2b79-25ae-4e2d-865b-145e0bace6aa" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] snapshot: 09c611e1-c538-4e9d-987b-bbc28e29a47d, volume: 063d2b79-25ae-4e2d-865b-145e0bace6aa, {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b273d80-9b53-4a28-8ba9-316ca33c391a]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:55 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d Apr 21 02:08:55 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:56 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3" returned: 0 in 0.464s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:56 devstack sudo[88446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3 Apr 21 02:08:56 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:56 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d" returned: 0 in 0.480s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b04b912-c764-4055-b0d9-fb033d3cf872(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Creating direct copy from snapshot {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c830834-ac9e-4d27-9e36-a48d8b617ab3]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:56 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 Apr 21 02:08:56 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:56 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3" returned: 0 in 0.430s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3" released by "delete_volume" :: held 0.922s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] Created reservations ['b2722844-c3b2-4d20-bf68-9aac308f10e0', 'a7cba759-1f93-4c7d-9cbc-fe2ca6605e7c', 'f958d462-3d06-4da2-b9a3-e4346bcdf514', '0ea075f3-4f8b-40bf-bc2e-752c2bfecda8'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:56 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:08:56 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-4b90da54-9c92-46d5-882d-ef42cbf99f61-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-4b90da54-9c92-46d5-882d-ef42cbf99f61-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "cinder-quobyte-4b90da54-9c92-46d5-882d-ef42cbf99f61" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-4b90da54-9c92-46d5-882d-ef42cbf99f61" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed9a908-4d49-45f9-9912-be9b72b05d2b]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:56 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61 Apr 21 02:08:56 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:56 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872" returned: 0 in 0.528s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG cinder.utils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Path /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-063d2b79-25ae-4e2d-865b-145e0bace6aa not found in is_blk_device check {{(pid=82184) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 02:08:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-063d2b79-25ae-4e2d-865b-145e0bace6aa {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:56 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-063d2b79-25ae-4e2d-865b-145e0bace6aa Apr 21 02:08:56 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:57 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.431s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:57 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:08:57 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] Deleted volume successfully. Apr 21 02:08:57 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7b571a08-7643-432b-a61c-3b069dd24b2b tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-87ee735d-99bf-48b5-9b4d-c7fdc1c28fc3-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:57 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61" returned: 0 in 0.488s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:57 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61 Apr 21 02:08:57 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:58 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4b90da54-9c92-46d5-882d-ef42cbf99f61" returned: 0 in 1.331s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:58 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-quobyte-4b90da54-9c92-46d5-882d-ef42cbf99f61" released by "delete_volume" :: held 1.853s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:58 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] Created reservations ['d3878144-8378-4a6e-99d3-bdf13b9e0dd7', '022ed61d-73be-4665-b8cc-7f4928bf6481', '7fb8ffc4-3552-4d5e-a61c-201eb0293747', '7f938b68-d6f3-423b-bca8-0e41666df3ea'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:08:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:08:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:08:58 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:08:58 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:08:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:08:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:58 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:08:58 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:58 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-063d2b79-25ae-4e2d-865b-145e0bace6aa" returned: 0 in 1.975s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:58 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd270db2-f33f-4c33-9749-2f5e2c10ba42]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:08:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:58 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 Apr 21 02:08:58 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:08:59 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.484s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:59 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:08:59 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] Deleted volume successfully. Apr 21 02:08:59 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d1a1aa13-ff4a-48d0-957a-097de23bfcd3 tempest-VolumesSnapshotTestJSON-575949388 None] Lock "cinder-4b90da54-9c92-46d5-882d-ef42cbf99f61-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:08:59 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Apr 21 02:08:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872" returned: 0 in 0.686s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:08:59 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Image conversion details: src /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872, size 1024.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-063d2b79-25ae-4e2d-865b-145e0bace6aa {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:08:59 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Converted 1024.00 MB image at 518.09 MB/s Apr 21 02:08:59 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-063d2b79-25ae-4e2d-865b-145e0bace6aa is being set with open permissions: ugo+rw: NotImplementedError Apr 21 02:08:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-063d2b79-25ae-4e2d-865b-145e0bace6aa {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:08:59 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-063d2b79-25ae-4e2d-865b-145e0bace6aa Apr 21 02:08:59 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:00 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-063d2b79-25ae-4e2d-865b-145e0bace6aa" returned: 0 in 0.451s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Lock "cinder-quobyte-063d2b79-25ae-4e2d-865b-145e0bace6aa" released by "_copy_volume_from_snapshot" :: held 4.166s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Acquiring lock "cinder-quobyte-09c611e1-c538-4e9d-987b-bbc28e29a47d" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Lock "cinder-quobyte-09c611e1-c538-4e9d-987b-bbc28e29a47d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Deleting offline snapshot 09c611e1-c538-4e9d-987b-bbc28e29a47d of volume 8b04b912-c764-4055-b0d9-fb033d3cf872 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:09:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] snapshot_file for this snap is: volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:09:00 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[750b5fb6-82bf-41b4-ba0d-d68081d4c3bf]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:00 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d Apr 21 02:09:00 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:00 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d" returned: 0 in 0.518s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b04b912-c764-4055-b0d9-fb033d3cf872(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:00 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[636c05d3-0988-4173-b469-3cbed035099a]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:00 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 Apr 21 02:09:00 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:01 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872" returned: 0 in 0.505s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:01 devstack sudo[88502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d Apr 21 02:09:01 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:01 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d" returned: 0 in 0.473s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:01 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d Apr 21 02:09:01 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:02 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872.09c611e1-c538-4e9d-987b-bbc28e29a47d" returned: 0 in 0.450s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Lock "cinder-quobyte-09c611e1-c538-4e9d-987b-bbc28e29a47d" released by "_delete_snapshot" :: held 1.992s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.036s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:02 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b3bfe068-94e7-4c27-851e-953f9139d8c2 tempest-GroupsV314Test-909414691 None] Create group from source-group-954fb4e5-7888-42ec-9ac1-73a62972177e completed successfully. Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] Acquiring lock "cinder-quobyte-063d2b79-25ae-4e2d-865b-145e0bace6aa" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] Lock "cinder-quobyte-063d2b79-25ae-4e2d-865b-145e0bace6aa" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf9fa11-e434-4e07-966a-0ff7ac5c6318]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-063d2b79-25ae-4e2d-865b-145e0bace6aa {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:09:03 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-063d2b79-25ae-4e2d-865b-145e0bace6aa Apr 21 02:09:03 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Flow 'volume_create_manager' (c7c04dcb-3084-4926-a973-0d524cbbd775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a16c5a-f701-4787-b9fc-df07234249d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a16c5a-f701-4787-b9fc-df07234249d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-996576212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57883440-f144-4bb4-b886-924be98b39f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2ad978924c4c52b8aad234761e9fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:03Z,use_quota=True,user_id='3f15610ccaec4f10ac768178eef0f157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bb0be4-7ace-4760-ab4e-f6a00eccd19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bb0be4-7ace-4760-ab4e-f6a00eccd19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8baf53c7-d2e5-4445-ba29-300418e83c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8baf53c7-d2e5-4445-ba29-300418e83c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57883440-f144-4bb4-b886-924be98b39f4', 'volume_name': 'volume-57883440-f144-4bb4-b886-924be98b39f4', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a98e073-47b2-4dc7-9883-cad72d1bfe00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a98e073-47b2-4dc7-9883-cad72d1bfe00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d399fb2-89f7-4c97-8399-b0710760559f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:03 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Volume 57883440-f144-4bb4-b886-924be98b39f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57883440-f144-4bb4-b886-924be98b39f4', 'volume_size': 1} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-996576212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57883440-f144-4bb4-b886-924be98b39f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2ad978924c4c52b8aad234761e9fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:03Z,use_quota=True,user_id='3f15610ccaec4f10ac768178eef0f157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Creating volume 57883440-f144-4bb4-b886-924be98b39f4 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:09:03 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:03 devstack sudo[88513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4 1073741824 Apr 21 02:09:03 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:03 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-063d2b79-25ae-4e2d-865b-145e0bace6aa" returned: 0 in 0.477s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-063d2b79-25ae-4e2d-865b-145e0bace6aa {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:03 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-063d2b79-25ae-4e2d-865b-145e0bace6aa Apr 21 02:09:03 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:03 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4 1073741824" returned: 0 in 0.483s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:03 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4 Apr 21 02:09:03 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:04 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-063d2b79-25ae-4e2d-865b-145e0bace6aa" returned: 0 in 0.434s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] Lock "cinder-quobyte-063d2b79-25ae-4e2d-865b-145e0bace6aa" released by "delete_volume" :: held 0.934s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] Created reservations ['cc2f3c40-8c8b-4ab9-98b2-35a688e84a04'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:04 devstack cinder-volume[82184]: WARNING cinder.quota [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-953748164 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-953748164, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:09:04 devstack cinder-volume[82184]: WARNING cinder.quota [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-953748164 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-953748164, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] Created reservations ['4a363005-07b4-4939-8d7f-91dcb664ead9', '1009d384-9de8-40d5-b00b-fdfcd36fb0e1', 'ded9230b-a120-49b5-b661-93c7763ecb7b', '004b3f24-9ce6-4a2e-962c-a6420041a62c'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:04 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4" returned: 0 in 0.438s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:04 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:09:04 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d399fb2-89f7-4c97-8399-b0710760559f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57883440-f144-4bb4-b886-924be98b39f4', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ceb1f9-72ae-454c-9f1a-364584d2f3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:04 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Volume volume-57883440-f144-4bb4-b886-924be98b39f4 (57883440-f144-4bb4-b886-924be98b39f4): created successfully Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ceb1f9-72ae-454c-9f1a-364584d2f3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Flow 'volume_create_manager' (c7c04dcb-3084-4926-a973-0d524cbbd775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:04 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-8362d3f8-0a62-4d6b-a402-42c12716cb4b tempest-VolumesSnapshotListTestJSON-2005307675 None] Created volume successfully. Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d846f0fd-1506-484c-a475-54b18af6a2d0 tempest-GroupsV314Test-909414691 None] Acquiring lock "cinder-quobyte-8b04b912-c764-4055-b0d9-fb033d3cf872" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d846f0fd-1506-484c-a475-54b18af6a2d0 tempest-GroupsV314Test-909414691 None] Lock "cinder-quobyte-8b04b912-c764-4055-b0d9-fb033d3cf872" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[690d18e4-1340-4126-b16a-0f71b1fa9a3a]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d846f0fd-1506-484c-a475-54b18af6a2d0 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:04 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 Apr 21 02:09:04 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:04 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.450s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:09:04 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-0f7d0c6c-18ae-4414-9698-628ce191a859 tempest-GroupsV314Test-909414691 None] Delete group completed successfully. Apr 21 02:09:04 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d846f0fd-1506-484c-a475-54b18af6a2d0 tempest-GroupsV314Test-909414691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872" returned: 0 in 0.465s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d846f0fd-1506-484c-a475-54b18af6a2d0 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:04 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872 Apr 21 02:09:04 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:05 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d846f0fd-1506-484c-a475-54b18af6a2d0 tempest-GroupsV314Test-909414691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8b04b912-c764-4055-b0d9-fb033d3cf872" returned: 0 in 0.415s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d846f0fd-1506-484c-a475-54b18af6a2d0 tempest-GroupsV314Test-909414691 None] Lock "cinder-quobyte-8b04b912-c764-4055-b0d9-fb033d3cf872" released by "delete_volume" :: held 0.921s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-d846f0fd-1506-484c-a475-54b18af6a2d0 tempest-GroupsV314Test-909414691 None] Created reservations ['a6584572-f553-4a0e-9ef3-ee46cd2583b8'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-d846f0fd-1506-484c-a475-54b18af6a2d0 tempest-GroupsV314Test-909414691 None] Created reservations ['8766e729-be62-4616-be9e-653e252f4244', 'f55a0c72-c73d-4015-b1f0-26c574eedc7e', '9c9ccf1d-4b5b-481e-9845-ff80c7341896', 'a35f481f-545a-4ef9-a7f2-08b4c6425a42'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d846f0fd-1506-484c-a475-54b18af6a2d0 tempest-GroupsV314Test-909414691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d846f0fd-1506-484c-a475-54b18af6a2d0 tempest-GroupsV314Test-909414691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d846f0fd-1506-484c-a475-54b18af6a2d0 tempest-GroupsV314Test-909414691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d846f0fd-1506-484c-a475-54b18af6a2d0 tempest-GroupsV314Test-909414691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d846f0fd-1506-484c-a475-54b18af6a2d0 tempest-GroupsV314Test-909414691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d846f0fd-1506-484c-a475-54b18af6a2d0 tempest-GroupsV314Test-909414691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:05 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:09:05 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] Creating offline snapshot 2f07729b-a8d1-4a31-94d1-a411785b8760 of volume 57883440-f144-4bb4-b886-924be98b39f4 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8db300e-0b2a-4e5f-b95f-9c71eecc808c]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:05 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4 Apr 21 02:09:05 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:05 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d846f0fd-1506-484c-a475-54b18af6a2d0 tempest-GroupsV314Test-909414691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.456s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-d846f0fd-1506-484c-a475-54b18af6a2d0 tempest-GroupsV314Test-909414691 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:09:05 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-d846f0fd-1506-484c-a475-54b18af6a2d0 tempest-GroupsV314Test-909414691 None] Delete group completed successfully. Apr 21 02:09:05 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4" returned: 0 in 0.503s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:06 devstack sudo[88547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 1G Apr 21 02:09:06 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:06 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 1G" returned: 0 in 0.546s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57883440-f144-4bb4-b886-924be98b39f4 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:06 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57883440-f144-4bb4-b886-924be98b39f4 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 Apr 21 02:09:06 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:07 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57883440-f144-4bb4-b886-924be98b39f4 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760" returned: 0 in 0.510s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:07 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 is being set with open permissions: ugo+rw Apr 21 02:09:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:07 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 Apr 21 02:09:07 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:07 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760" returned: 0 in 0.445s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:07 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.info Apr 21 02:09:07 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:07 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.info" returned: 0 in 0.439s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:07 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.info is being set with open permissions: ugo+rw Apr 21 02:09:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:07 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.info Apr 21 02:09:07 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:08 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-4208f6c6-9089-4320-bcaf-2f71ef8ed861 tempest-GroupsV320Test-989080595 None] Group tempest-GroupsV320Test-Group-1800456157: creating Apr 21 02:09:08 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-4208f6c6-9089-4320-bcaf-2f71ef8ed861 tempest-GroupsV320Test-989080595 None] Group tempest-GroupsV320Test-Group-1800456157: created successfully Apr 21 02:09:08 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-4208f6c6-9089-4320-bcaf-2f71ef8ed861 tempest-GroupsV320Test-989080595 None] Create group completed successfully. Apr 21 02:09:08 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.info" returned: 0 in 0.437s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.939s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:08 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-903def2e-b354-405f-8399-26bcfd441922 tempest-VolumesSnapshotListTestJSON-2005307675 None] Create snapshot completed successfully Apr 21 02:09:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-91cd316f-3b6a-42c3-ad13-4cc51b4c6c3a tempest-VolumesSnapshotListTestJSON-2005307675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-91cd316f-3b6a-42c3-ad13-4cc51b4c6c3a tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:08 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-91cd316f-3b6a-42c3-ad13-4cc51b4c6c3a tempest-VolumesSnapshotListTestJSON-2005307675 None] Creating offline snapshot e8f1dd7d-5a29-4ed7-968f-8b36260892e2 of volume 57883440-f144-4bb4-b886-924be98b39f4 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:09:08 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01397e0-3552-4d26-9ac5-0b02918f62cd]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-91cd316f-3b6a-42c3-ad13-4cc51b4c6c3a tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:08 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 Apr 21 02:09:08 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:09 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-91cd316f-3b6a-42c3-ad13-4cc51b4c6c3a tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760" returned: 0 in 0.454s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-91cd316f-3b6a-42c3-ad13-4cc51b4c6c3a tempest-VolumesSnapshotListTestJSON-2005307675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57883440-f144-4bb4-b886-924be98b39f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-91cd316f-3b6a-42c3-ad13-4cc51b4c6c3a tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:09 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 1G Apr 21 02:09:09 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:09 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-91cd316f-3b6a-42c3-ad13-4cc51b4c6c3a tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 1G" returned: 0 in 0.521s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-91cd316f-3b6a-42c3-ad13-4cc51b4c6c3a tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:09 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 Apr 21 02:09:09 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:09 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-ae7b596a-d7a1-4eb5-9084-5a7acdd020ee tempest-GroupsV320Test-989080595 None] Created reservations ['422c303d-922e-4516-96fc-4d61444f7f30'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae7b596a-d7a1-4eb5-9084-5a7acdd020ee tempest-GroupsV320Test-989080595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae7b596a-d7a1-4eb5-9084-5a7acdd020ee tempest-GroupsV320Test-989080595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae7b596a-d7a1-4eb5-9084-5a7acdd020ee tempest-GroupsV320Test-989080595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae7b596a-d7a1-4eb5-9084-5a7acdd020ee tempest-GroupsV320Test-989080595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae7b596a-d7a1-4eb5-9084-5a7acdd020ee tempest-GroupsV320Test-989080595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae7b596a-d7a1-4eb5-9084-5a7acdd020ee tempest-GroupsV320Test-989080595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:09 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:09:09 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:10 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-91cd316f-3b6a-42c3-ad13-4cc51b4c6c3a tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2" returned: 0 in 0.449s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:10 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-91cd316f-3b6a-42c3-ad13-4cc51b4c6c3a tempest-VolumesSnapshotListTestJSON-2005307675 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 is being set with open permissions: ugo+rw Apr 21 02:09:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-91cd316f-3b6a-42c3-ad13-4cc51b4c6c3a tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:10 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 Apr 21 02:09:10 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:10 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae7b596a-d7a1-4eb5-9084-5a7acdd020ee tempest-GroupsV320Test-989080595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.403s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:10 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-ae7b596a-d7a1-4eb5-9084-5a7acdd020ee tempest-GroupsV320Test-989080595 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:09:10 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-ae7b596a-d7a1-4eb5-9084-5a7acdd020ee tempest-GroupsV320Test-989080595 None] Delete group completed successfully. Apr 21 02:09:10 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-91cd316f-3b6a-42c3-ad13-4cc51b4c6c3a tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2" returned: 0 in 0.403s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-91cd316f-3b6a-42c3-ad13-4cc51b4c6c3a tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.873s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:10 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-91cd316f-3b6a-42c3-ad13-4cc51b4c6c3a tempest-VolumesSnapshotListTestJSON-2005307675 None] Create snapshot completed successfully Apr 21 02:09:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-36d444e9-363e-43fa-a445-57c59fffdee2 tempest-VolumesSnapshotListTestJSON-2005307675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-36d444e9-363e-43fa-a445-57c59fffdee2 tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:10 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-36d444e9-363e-43fa-a445-57c59fffdee2 tempest-VolumesSnapshotListTestJSON-2005307675 None] Creating offline snapshot 8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3 of volume 57883440-f144-4bb4-b886-924be98b39f4 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:09:10 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b96736-45e5-4a7c-b746-c83e3517a7e5]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-36d444e9-363e-43fa-a445-57c59fffdee2 tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:10 devstack sudo[88587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 Apr 21 02:09:10 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:11 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-36d444e9-363e-43fa-a445-57c59fffdee2 tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2" returned: 0 in 0.555s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:11 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-36d444e9-363e-43fa-a445-57c59fffdee2 tempest-VolumesSnapshotListTestJSON-2005307675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57883440-f144-4bb4-b886-924be98b39f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-36d444e9-363e-43fa-a445-57c59fffdee2 tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:11 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3 1G Apr 21 02:09:11 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:11 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-36d444e9-363e-43fa-a445-57c59fffdee2 tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3 1G" returned: 0 in 0.555s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-36d444e9-363e-43fa-a445-57c59fffdee2 tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:11 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3 Apr 21 02:09:11 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:12 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-36d444e9-363e-43fa-a445-57c59fffdee2 tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3" returned: 0 in 0.502s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:12 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-36d444e9-363e-43fa-a445-57c59fffdee2 tempest-VolumesSnapshotListTestJSON-2005307675 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3 is being set with open permissions: ugo+rw Apr 21 02:09:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-36d444e9-363e-43fa-a445-57c59fffdee2 tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:12 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3 Apr 21 02:09:12 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:12 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-36d444e9-363e-43fa-a445-57c59fffdee2 tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3" returned: 0 in 0.452s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:12 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:DELETE=15,cinder:SELECT=205,cinder:UPDATE=237,cinder:INSERT=63 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:09:12 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:UPDATE=209,cinder:INSERT=42,cinder:SELECT=194,cinder:DELETE=14 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:09:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-36d444e9-363e-43fa-a445-57c59fffdee2 tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.117s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:12 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-36d444e9-363e-43fa-a445-57c59fffdee2 tempest-VolumesSnapshotListTestJSON-2005307675 None] Create snapshot completed successfully Apr 21 02:09:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] Acquiring lock "cinder-8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] Acquiring lock "cinder-quobyte-57883440-f144-4bb4-b886-924be98b39f4" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-quobyte-57883440-f144-4bb4-b886-924be98b39f4" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] Acquiring lock "cinder-quobyte-8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-quobyte-8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] Deleting offline snapshot 8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3 of volume 57883440-f144-4bb4-b886-924be98b39f4 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:09:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] snapshot_file for this snap is: volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:09:14 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c9df76-2443-46ae-94ce-3416c6823517]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:14 devstack sudo[88607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3 Apr 21 02:09:14 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:15 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3" returned: 0 in 0.538s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57883440-f144-4bb4-b886-924be98b39f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:15 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a737cc-b83d-4727-bc0f-4d7115e50ed3]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:15 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 Apr 21 02:09:15 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:15 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2" returned: 0 in 0.529s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57883440-f144-4bb4-b886-924be98b39f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:15 devstack sudo[88618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3 Apr 21 02:09:15 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:16 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3" returned: 0 in 0.552s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:16 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3 Apr 21 02:09:16 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:16 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3" returned: 0 in 0.458s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-quobyte-8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3" released by "_delete_snapshot" :: held 2.127s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-quobyte-57883440-f144-4bb4-b886-924be98b39f4" released by "delete_snapshot" :: held 2.147s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:16 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] Created reservations ['0f42871d-c795-4b71-8b64-0533909eef21', '3170825a-07d7-44b8-9b4e-dde26512db72', 'e22593ee-eeb5-426a-b1fc-72a98e9fb4c1', '4abaaf58-746f-4f21-b601-70e1c4f899bb'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:16 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] Delete snapshot completed successfully. Apr 21 02:09:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5831d8e3-dd8b-4224-996f-cbfdebe0147c tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-8b48e104-da74-4d8f-b0bf-eae3d0cd2ef3-delete_snapshot" released by "delete_snapshot" :: held 2.238s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Flow 'volume_create_manager' (dcc4b002-3903-4c20-a13a-2341a070e7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04af5f14-7049-487f-9ab9-3886c49dc2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04af5f14-7049-487f-9ab9-3886c49dc2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1427949005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ec75d3-1966-4b53-830c-e900fd81bb0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5653b7ba64542fc95deab3a81467676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:17Z,use_quota=True,user_id='daee3218ae8c438f91efcda8bc9d23ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e8a715-fc2b-42c5-9866-5e7a5f45fee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e8a715-fc2b-42c5-9866-5e7a5f45fee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c05b90f-6115-4d7e-9048-ee45eac8813b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c05b90f-6115-4d7e-9048-ee45eac8813b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7ec75d3-1966-4b53-830c-e900fd81bb0e', 'volume_name': 'volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063a27f2-aff1-4fb0-9673-5a304bbc532f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063a27f2-aff1-4fb0-9673-5a304bbc532f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c55f39-67a9-4ca1-a465-ff5ed3466a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:17 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Volume c7ec75d3-1966-4b53-830c-e900fd81bb0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e', 'volume_size': 1} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1427949005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ec75d3-1966-4b53-830c-e900fd81bb0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5653b7ba64542fc95deab3a81467676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:17Z,use_quota=True,user_id='daee3218ae8c438f91efcda8bc9d23ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Creating volume c7ec75d3-1966-4b53-830c-e900fd81bb0e {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:09:17 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:17 devstack sudo[88626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e 1073741824 Apr 21 02:09:17 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] Acquiring lock "cinder-e8f1dd7d-5a29-4ed7-968f-8b36260892e2-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-e8f1dd7d-5a29-4ed7-968f-8b36260892e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] Acquiring lock "cinder-quobyte-57883440-f144-4bb4-b886-924be98b39f4" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-quobyte-57883440-f144-4bb4-b886-924be98b39f4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] Acquiring lock "cinder-quobyte-e8f1dd7d-5a29-4ed7-968f-8b36260892e2" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-quobyte-e8f1dd7d-5a29-4ed7-968f-8b36260892e2" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] Deleting offline snapshot e8f1dd7d-5a29-4ed7-968f-8b36260892e2 of volume 57883440-f144-4bb4-b886-924be98b39f4 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] snapshot_file for this snap is: volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82fce4b-9d19-4cda-bc0f-839557001d03]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:17 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 Apr 21 02:09:17 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:17 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e 1073741824" returned: 0 in 0.488s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:17 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e Apr 21 02:09:17 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:18 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2" returned: 0 in 0.489s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57883440-f144-4bb4-b886-924be98b39f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:18 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a72961c-540c-48bb-8fd2-ef5503f08116]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:18 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 Apr 21 02:09:18 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:18 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e" returned: 0 in 0.431s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:09:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c55f39-67a9-4ca1-a465-ff5ed3466a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42205222-e808-4875-b2a2-bebfe79f766c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:18 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Volume volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e (c7ec75d3-1966-4b53-830c-e900fd81bb0e): created successfully Apr 21 02:09:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42205222-e808-4875-b2a2-bebfe79f766c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Flow 'volume_create_manager' (dcc4b002-3903-4c20-a13a-2341a070e7d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:18 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-900200f4-eeab-41f0-be9a-4d91e9e5efce tempest-SnapshotsActionsTest-1360144753 None] Created volume successfully. Apr 21 02:09:18 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760" returned: 0 in 0.477s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57883440-f144-4bb4-b886-924be98b39f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:18 devstack sudo[88644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 Apr 21 02:09:18 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:19 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2" returned: 0 in 0.451s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:19 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2 Apr 21 02:09:19 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] Creating offline snapshot 998f57ce-e6ce-40df-8800-f700c9cd67be of volume c7ec75d3-1966-4b53-830c-e900fd81bb0e {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22f8072-d06e-4a35-8625-f7b875ba6b8d]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:19 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.e8f1dd7d-5a29-4ed7-968f-8b36260892e2" returned: 0 in 0.441s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-quobyte-e8f1dd7d-5a29-4ed7-968f-8b36260892e2" released by "_delete_snapshot" :: held 1.901s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:19 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e Apr 21 02:09:19 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-quobyte-57883440-f144-4bb4-b886-924be98b39f4" released by "delete_snapshot" :: held 1.912s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] Created reservations ['17197c36-55af-4ca9-97fc-a9f9733ea28a', 'a9bf48c2-7fbc-4431-bd12-cf1079670e02', '480d3198-8b51-4629-96f5-24b15916a2fa', '09b908f1-45eb-4d84-8e62-3d71e032f0a4'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:19 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] Delete snapshot completed successfully. Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-70edfeab-673b-4659-9448-50effb16159f tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-e8f1dd7d-5a29-4ed7-968f-8b36260892e2-delete_snapshot" released by "delete_snapshot" :: held 2.004s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] Acquiring lock "cinder-2f07729b-a8d1-4a31-94d1-a411785b8760-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-2f07729b-a8d1-4a31-94d1-a411785b8760-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] Acquiring lock "cinder-quobyte-57883440-f144-4bb4-b886-924be98b39f4" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-quobyte-57883440-f144-4bb4-b886-924be98b39f4" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] Acquiring lock "cinder-quobyte-2f07729b-a8d1-4a31-94d1-a411785b8760" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-quobyte-2f07729b-a8d1-4a31-94d1-a411785b8760" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] Deleting offline snapshot 2f07729b-a8d1-4a31-94d1-a411785b8760 of volume 57883440-f144-4bb4-b886-924be98b39f4 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] snapshot_file for this snap is: volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b80e22-3f05-42a2-acc7-d98d4b01c566]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:19 devstack sudo[88654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 Apr 21 02:09:19 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:20 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e" returned: 0 in 0.509s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:20 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be 1G Apr 21 02:09:20 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:20 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760" returned: 0 in 0.463s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:20 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57883440-f144-4bb4-b886-924be98b39f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:20 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a5d023-a931-4361-a711-2d1bdfe4d213]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:20 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4 Apr 21 02:09:20 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:20 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be 1G" returned: 0 in 0.456s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:20 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be Apr 21 02:09:20 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:20 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4" returned: 0 in 0.471s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:20 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 Apr 21 02:09:20 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:20 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be" returned: 0 in 0.455s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:20 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be is being set with open permissions: ugo+rw Apr 21 02:09:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:20 devstack sudo[88679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be Apr 21 02:09:20 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:21 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760" returned: 0 in 0.452s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:21 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760 Apr 21 02:09:21 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:21 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be" returned: 0 in 0.414s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:21 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.info Apr 21 02:09:21 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:21 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4.2f07729b-a8d1-4a31-94d1-a411785b8760" returned: 0 in 0.411s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-quobyte-2f07729b-a8d1-4a31-94d1-a411785b8760" released by "_delete_snapshot" :: held 1.847s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-quobyte-57883440-f144-4bb4-b886-924be98b39f4" released by "delete_snapshot" :: held 1.860s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:21 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] Created reservations ['c52921ce-aaab-4c97-ba85-b68c7bf28027', 'b577eaf7-74f3-44de-87f6-bd01a8503ff4', '64d5dc03-f4b6-42de-9718-2a2353db0be9', '2c0cd3bf-0b85-49bb-bb1e-ea9ed28ce970'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:21 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] Delete snapshot completed successfully. Apr 21 02:09:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-57195007-409a-4c3a-a468-56c155c42ca1 tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-2f07729b-a8d1-4a31-94d1-a411785b8760-delete_snapshot" released by "delete_snapshot" :: held 1.945s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:21 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.info" returned: 0 in 0.442s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:21 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.info is being set with open permissions: ugo+rw Apr 21 02:09:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:21 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.info Apr 21 02:09:21 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] Acquiring lock "cinder-57883440-f144-4bb4-b886-924be98b39f4-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-57883440-f144-4bb4-b886-924be98b39f4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] Acquiring lock "cinder-quobyte-57883440-f144-4bb4-b886-924be98b39f4" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-quobyte-57883440-f144-4bb4-b886-924be98b39f4" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:22 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fe606d-0533-4ac4-aefe-a8499cb7ae0a]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:22 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4 Apr 21 02:09:22 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:22 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.info" returned: 0 in 0.427s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.762s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:22 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-42374f78-1a5c-4521-9b32-e4264db4a59f tempest-SnapshotsActionsTest-1360144753 None] Create snapshot completed successfully Apr 21 02:09:22 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4" returned: 0 in 0.473s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:22 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4 Apr 21 02:09:22 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-45b12641-2014-4d7b-a509-958a4e899420 tempest-SnapshotsActionsTest-1360144753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-45b12641-2014-4d7b-a509-958a4e899420 tempest-SnapshotsActionsTest-1360144753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:22 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-45b12641-2014-4d7b-a509-958a4e899420 tempest-SnapshotsActionsTest-1360144753 None] Creating offline snapshot 2825c56f-190f-4ecb-ad3a-8851d21eadef of volume c7ec75d3-1966-4b53-830c-e900fd81bb0e {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:09:22 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e771b3-e24c-45b8-a031-9203e2ac56d1]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-45b12641-2014-4d7b-a509-958a4e899420 tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:22 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-57883440-f144-4bb4-b886-924be98b39f4" returned: 0 in 0.479s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-quobyte-57883440-f144-4bb4-b886-924be98b39f4" released by "delete_volume" :: held 0.979s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:23 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be Apr 21 02:09:23 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:23 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] Created reservations ['623a79ed-927a-4a16-95c3-ed84c46020fb', '8c9f6617-765f-4604-87bd-8f33503917b6', '07d60a6e-a030-4f05-882a-33035f8d7ffa', '4dd4efb1-99b1-4f73-a898-6977e8123751'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:23 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:09:23 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:23 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-45b12641-2014-4d7b-a509-958a4e899420 tempest-SnapshotsActionsTest-1360144753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be" returned: 0 in 0.496s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-45b12641-2014-4d7b-a509-958a4e899420 tempest-SnapshotsActionsTest-1360144753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-45b12641-2014-4d7b-a509-958a4e899420 tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:23 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef 1G Apr 21 02:09:23 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:23 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.416s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:23 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:09:23 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] Deleted volume successfully. Apr 21 02:09:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3cf0d8c-4c55-43bc-ba85-bed407bc10fc tempest-VolumesSnapshotListTestJSON-2005307675 None] Lock "cinder-57883440-f144-4bb4-b886-924be98b39f4-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:23 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-45b12641-2014-4d7b-a509-958a4e899420 tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef 1G" returned: 0 in 0.479s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-45b12641-2014-4d7b-a509-958a4e899420 tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:23 devstack sudo[88716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef Apr 21 02:09:23 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:24 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-45b12641-2014-4d7b-a509-958a4e899420 tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef" returned: 0 in 0.463s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:24 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-45b12641-2014-4d7b-a509-958a4e899420 tempest-SnapshotsActionsTest-1360144753 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef is being set with open permissions: ugo+rw Apr 21 02:09:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-45b12641-2014-4d7b-a509-958a4e899420 tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:24 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef Apr 21 02:09:24 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:24 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-45b12641-2014-4d7b-a509-958a4e899420 tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef" returned: 0 in 0.461s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-45b12641-2014-4d7b-a509-958a4e899420 tempest-SnapshotsActionsTest-1360144753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.950s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:24 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-45b12641-2014-4d7b-a509-958a4e899420 tempest-SnapshotsActionsTest-1360144753 None] Create snapshot completed successfully Apr 21 02:09:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] Acquiring lock "cinder-2825c56f-190f-4ecb-ad3a-8851d21eadef-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-2825c56f-190f-4ecb-ad3a-8851d21eadef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] Acquiring lock "cinder-quobyte-c7ec75d3-1966-4b53-830c-e900fd81bb0e" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-quobyte-c7ec75d3-1966-4b53-830c-e900fd81bb0e" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] Acquiring lock "cinder-quobyte-2825c56f-190f-4ecb-ad3a-8851d21eadef" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-quobyte-2825c56f-190f-4ecb-ad3a-8851d21eadef" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] Deleting offline snapshot 2825c56f-190f-4ecb-ad3a-8851d21eadef of volume c7ec75d3-1966-4b53-830c-e900fd81bb0e {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:09:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] snapshot_file for this snap is: volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:09:25 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e9e1f8-5c00-4e24-a941-3aeaed0666da]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:25 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef Apr 21 02:09:25 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:25 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef" returned: 0 in 0.506s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:25 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a06cb0-9218-42b6-9040-d0c25a0dd631]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:25 devstack sudo[88730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be Apr 21 02:09:25 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Flow 'volume_create_manager' (5a2e7e62-400e-43f0-836f-b0becc9c283c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7329e1a-de72-43ef-a385-0572429c9d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7329e1a-de72-43ef-a385-0572429c9d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-905467664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad664cbc-8241-4f5c-80c3-0ccb049b6bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eafa04bac5ca454ba6f80bd51de4ffcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:26Z,use_quota=True,user_id='ae93b9e2a5eb4dfdb2c4bb8581478e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95823709-27b3-46ad-b1cc-7718dcae87b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95823709-27b3-46ad-b1cc-7718dcae87b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d033653c-5571-425f-ae76-b064552e7f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d033653c-5571-425f-ae76-b064552e7f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad664cbc-8241-4f5c-80c3-0ccb049b6bec', 'volume_name': 'volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec', 'volume_size': 2}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cd5d7b-e936-4267-947b-a8016de0b0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cd5d7b-e936-4267-947b-a8016de0b0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec7da82-b030-424b-b235-78fe0126daee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:26 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Volume ad664cbc-8241-4f5c-80c3-0ccb049b6bec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec', 'volume_size': 2} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-905467664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad664cbc-8241-4f5c-80c3-0ccb049b6bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eafa04bac5ca454ba6f80bd51de4ffcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:26Z,use_quota=True,user_id='ae93b9e2a5eb4dfdb2c4bb8581478e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Creating volume ad664cbc-8241-4f5c-80c3-0ccb049b6bec {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:09:26 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec 2147483648 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:26 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec 2147483648 Apr 21 02:09:26 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:26 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be" returned: 0 in 0.503s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:26 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef Apr 21 02:09:26 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:26 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec 2147483648" returned: 0 in 0.526s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:26 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec Apr 21 02:09:26 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:26 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef" returned: 0 in 0.491s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:26 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef Apr 21 02:09:26 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:27 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec" returned: 0 in 0.428s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:09:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:27 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec7da82-b030-424b-b235-78fe0126daee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec', 'volume_size': 2}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:27 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49797da-e092-452e-8351-95f2440ab1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:27 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:27 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Volume volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec (ad664cbc-8241-4f5c-80c3-0ccb049b6bec): created successfully Apr 21 02:09:27 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49797da-e092-452e-8351-95f2440ab1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:27 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Flow 'volume_create_manager' (5a2e7e62-400e-43f0-836f-b0becc9c283c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.2825c56f-190f-4ecb-ad3a-8851d21eadef" returned: 0 in 0.428s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:27 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-5173c89d-ce43-474f-9152-5521450ff1e5 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Created volume successfully. Apr 21 02:09:27 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-quobyte-2825c56f-190f-4ecb-ad3a-8851d21eadef" released by "_delete_snapshot" :: held 1.986s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:27 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-quobyte-c7ec75d3-1966-4b53-830c-e900fd81bb0e" released by "delete_snapshot" :: held 1.996s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:27 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] Created reservations ['b49a40bb-d126-4ae2-8dac-064bff23c894', 'f0007402-b121-4a11-a0f6-1866ba5a70e7', 'f9acd197-7771-43ac-8659-485ec34c33ac', '0b1aaef8-bad8-46b2-82dd-7d2713072fae'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:27 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] Delete snapshot completed successfully. Apr 21 02:09:27 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4641622c-2254-4440-a8af-c64df9680cb1 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-2825c56f-190f-4ecb-ad3a-8851d21eadef-delete_snapshot" released by "delete_snapshot" :: held 2.086s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:28 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Creating offline snapshot 96d2ee6a-83bc-4634-ac26-bfe0faf97ab6 of volume ad664cbc-8241-4f5c-80c3-0ccb049b6bec {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:09:28 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[165f2c2d-e082-4137-9ce2-991e0a7a4d26]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:28 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec Apr 21 02:09:28 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6abfb676-8732-4f30-ad6c-38cf7af95195 tempest-SnapshotsActionsTest-1360144753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:28 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec" returned: 0 in 0.487s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6 2G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:28 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6 2G Apr 21 02:09:28 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:29 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6 2G" returned: 0 in 0.469s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:29 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6 Apr 21 02:09:29 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:29 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6" returned: 0 in 0.431s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:29 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6 is being set with open permissions: ugo+rw Apr 21 02:09:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:29 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6 Apr 21 02:09:29 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:30 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6" returned: 0 in 0.411s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:30 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.info Apr 21 02:09:30 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:30 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.info" returned: 0 in 0.431s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:30 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.info is being set with open permissions: ugo+rw Apr 21 02:09:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:30 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.info Apr 21 02:09:30 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:30 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.info" returned: 0 in 0.398s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.693s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6abfb676-8732-4f30-ad6c-38cf7af95195 tempest-SnapshotsActionsTest-1360144753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.503s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:30 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-6abfb676-8732-4f30-ad6c-38cf7af95195 tempest-SnapshotsActionsTest-1360144753 None] Creating offline snapshot 8e238da2-73b0-4fa6-af9c-85fc8804ac5d of volume c7ec75d3-1966-4b53-830c-e900fd81bb0e {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:09:30 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[157953ae-cf1a-4a8d-ae3c-c5d507dc45b2]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6abfb676-8732-4f30-ad6c-38cf7af95195 tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:30 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-638e1610-733b-4312-a3f2-bac7906e4435 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Create snapshot completed successfully Apr 21 02:09:31 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be Apr 21 02:09:31 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Acquiring lock "cinder-96d2ee6a-83bc-4634-ac26-bfe0faf97ab6-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Lock "cinder-96d2ee6a-83bc-4634-ac26-bfe0faf97ab6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Acquiring lock "cinder-quobyte-ad664cbc-8241-4f5c-80c3-0ccb049b6bec" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Lock "cinder-quobyte-ad664cbc-8241-4f5c-80c3-0ccb049b6bec" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Acquiring lock "cinder-quobyte-96d2ee6a-83bc-4634-ac26-bfe0faf97ab6" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Lock "cinder-quobyte-96d2ee6a-83bc-4634-ac26-bfe0faf97ab6" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Deleting offline snapshot 96d2ee6a-83bc-4634-ac26-bfe0faf97ab6 of volume ad664cbc-8241-4f5c-80c3-0ccb049b6bec {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] snapshot_file for this snap is: volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7463fdde-ea3b-4120-8293-9143ec1f53b9]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:31 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6abfb676-8732-4f30-ad6c-38cf7af95195 tempest-SnapshotsActionsTest-1360144753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be" returned: 0 in 0.514s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-6abfb676-8732-4f30-ad6c-38cf7af95195 tempest-SnapshotsActionsTest-1360144753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6abfb676-8732-4f30-ad6c-38cf7af95195 tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:31 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d 1G Apr 21 02:09:31 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:31 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6 Apr 21 02:09:31 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:31 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6" returned: 0 in 0.483s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[abefaec6-53e9-45e1-b7a1-fa87d1874094]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:31 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6abfb676-8732-4f30-ad6c-38cf7af95195 tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d 1G" returned: 0 in 0.471s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6abfb676-8732-4f30-ad6c-38cf7af95195 tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:31 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d Apr 21 02:09:31 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:32 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec Apr 21 02:09:32 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:32 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6abfb676-8732-4f30-ad6c-38cf7af95195 tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d" returned: 0 in 0.416s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:32 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-6abfb676-8732-4f30-ad6c-38cf7af95195 tempest-SnapshotsActionsTest-1360144753 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d is being set with open permissions: ugo+rw Apr 21 02:09:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6abfb676-8732-4f30-ad6c-38cf7af95195 tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:32 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d Apr 21 02:09:32 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:32 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec" returned: 0 in 0.478s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:32 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6 Apr 21 02:09:32 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:32 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6abfb676-8732-4f30-ad6c-38cf7af95195 tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d" returned: 0 in 0.413s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6abfb676-8732-4f30-ad6c-38cf7af95195 tempest-SnapshotsActionsTest-1360144753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:32 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-6abfb676-8732-4f30-ad6c-38cf7af95195 tempest-SnapshotsActionsTest-1360144753 None] Create snapshot completed successfully Apr 21 02:09:32 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6" returned: 0 in 0.464s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:32 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6 Apr 21 02:09:32 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:33 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec.96d2ee6a-83bc-4634-ac26-bfe0faf97ab6" returned: 0 in 0.403s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Lock "cinder-quobyte-96d2ee6a-83bc-4634-ac26-bfe0faf97ab6" released by "_delete_snapshot" :: held 1.882s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Lock "cinder-quobyte-ad664cbc-8241-4f5c-80c3-0ccb049b6bec" released by "delete_snapshot" :: held 1.892s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Created reservations ['e3f4d201-47b5-472f-8335-6b7fe3cf4ca8', '253a13c1-68a6-4b01-ab11-c8510cf2ec38', 'baa3f67f-3a46-4b59-8266-b7f864124dd0', 'e97a5f5e-1a64-4ad1-ab36-e9076e77fee1'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:33 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Delete snapshot completed successfully. Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f042c2d2-d8ae-48a2-b938-a9869d88a530 tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Lock "cinder-96d2ee6a-83bc-4634-ac26-bfe0faf97ab6-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Acquiring lock "cinder-ad664cbc-8241-4f5c-80c3-0ccb049b6bec-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Lock "cinder-ad664cbc-8241-4f5c-80c3-0ccb049b6bec-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Acquiring lock "cinder-quobyte-ad664cbc-8241-4f5c-80c3-0ccb049b6bec" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Lock "cinder-quobyte-ad664cbc-8241-4f5c-80c3-0ccb049b6bec" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f937e2-c1dc-4427-ba9f-170a07e64f93]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] Acquiring lock "cinder-8e238da2-73b0-4fa6-af9c-85fc8804ac5d-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-8e238da2-73b0-4fa6-af9c-85fc8804ac5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] Acquiring lock "cinder-quobyte-c7ec75d3-1966-4b53-830c-e900fd81bb0e" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-quobyte-c7ec75d3-1966-4b53-830c-e900fd81bb0e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] Acquiring lock "cinder-quobyte-8e238da2-73b0-4fa6-af9c-85fc8804ac5d" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-quobyte-8e238da2-73b0-4fa6-af9c-85fc8804ac5d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] Deleting offline snapshot 8e238da2-73b0-4fa6-af9c-85fc8804ac5d of volume c7ec75d3-1966-4b53-830c-e900fd81bb0e {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] snapshot_file for this snap is: volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b219524c-8ec9-415b-b80a-7565eb5b6349]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:33 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec Apr 21 02:09:33 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:33 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d Apr 21 02:09:33 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:34 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec" returned: 0 in 0.483s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:34 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec Apr 21 02:09:34 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:34 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d" returned: 0 in 0.469s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:34 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:34 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fbfba6-f7fd-4930-846f-5c2943e08f00]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:34 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be Apr 21 02:09:34 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:34 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ad664cbc-8241-4f5c-80c3-0ccb049b6bec" returned: 0 in 0.400s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:34 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Lock "cinder-quobyte-ad664cbc-8241-4f5c-80c3-0ccb049b6bec" released by "delete_volume" :: held 0.921s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:34 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Created reservations ['bca33dfc-599f-4e8b-b378-f3b8278248d4', '610e11a2-274d-4afe-ab5a-f0a61b6b1c9d', '81cc5bc5-5a5f-4320-a6fe-0e147b06984b', '00e49126-beb9-43b9-b782-1442bcc0176a'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:34 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:34 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:34 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:09:34 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:34 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be" returned: 0 in 0.462s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:34 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:34 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d Apr 21 02:09:34 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:35 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d" returned: 0 in 0.504s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:35 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:35 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d Apr 21 02:09:35 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.562s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:35 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:09:35 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Deleted volume successfully. Apr 21 02:09:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-dd24cc07-2e72-4a4a-9626-8722cb25008c tempest-VolumesSnapshotNegativeTestJSON-1012109678 None] Lock "cinder-ad664cbc-8241-4f5c-80c3-0ccb049b6bec-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:35 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.8e238da2-73b0-4fa6-af9c-85fc8804ac5d" returned: 0 in 0.473s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-quobyte-8e238da2-73b0-4fa6-af9c-85fc8804ac5d" released by "_delete_snapshot" :: held 1.950s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-quobyte-c7ec75d3-1966-4b53-830c-e900fd81bb0e" released by "delete_snapshot" :: held 1.961s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:35 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] Created reservations ['93a85ee9-615d-4d0c-847b-0f5cb63cc28e', '961c806e-807f-474a-a198-b91b5fac701a', '7fc19772-5fe1-477f-b9e2-f33c44f1b706', 'f98fb1d6-3027-47e3-b4e1-e67c690e8512'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:35 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] Delete snapshot completed successfully. Apr 21 02:09:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0ca879f2-e73c-4043-815c-83fa85807171 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-8e238da2-73b0-4fa6-af9c-85fc8804ac5d-delete_snapshot" released by "delete_snapshot" :: held 2.037s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-249d212e-fb63-49a5-806b-a3703f98b4d1 tempest-SnapshotsActionsTest-1360144753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-249d212e-fb63-49a5-806b-a3703f98b4d1 tempest-SnapshotsActionsTest-1360144753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-249d212e-fb63-49a5-806b-a3703f98b4d1 tempest-SnapshotsActionsTest-1360144753 None] Creating offline snapshot c0d5f23a-e240-4755-b1cd-8c0f0dd060b6 of volume c7ec75d3-1966-4b53-830c-e900fd81bb0e {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd40892-0edb-4204-ac9a-0276d523dc12]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-249d212e-fb63-49a5-806b-a3703f98b4d1 tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:36 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be Apr 21 02:09:36 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Flow 'volume_create_manager' (5026a543-60f1-453c-ad3f-c28048317f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9006038-d115-4dbd-bc0a-b64e7e28882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9006038-d115-4dbd-bc0a-b64e7e28882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1260781863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=849856e9-eec0-4506-8163-c7ac660a5976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40a7c0792db457abfb4d92558963bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:36Z,use_quota=True,user_id='5307a190229742f982fc584c4acf5d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15ba469-2d18-49b9-bacb-7aa4fe6054df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15ba469-2d18-49b9-bacb-7aa4fe6054df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0dce146-d789-4c3d-9fec-1f61248ebd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0dce146-d789-4c3d-9fec-1f61248ebd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '849856e9-eec0-4506-8163-c7ac660a5976', 'volume_name': 'volume-849856e9-eec0-4506-8163-c7ac660a5976', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1547a424-bee4-494c-ac82-18a870fbd9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1547a424-bee4-494c-ac82-18a870fbd9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7e33e0-c23e-4f91-9b79-b01b2d35e3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Volume 849856e9-eec0-4506-8163-c7ac660a5976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-849856e9-eec0-4506-8163-c7ac660a5976', 'volume_size': 1} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:09:36 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Flow 'volume_create_manager' (bd80bd90-82ab-4029-8c4b-1d3ecb463fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed935ab-f203-41aa-98f5-1dfad72f7c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-249d212e-fb63-49a5-806b-a3703f98b4d1 tempest-SnapshotsActionsTest-1360144753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be" returned: 0 in 0.515s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-249d212e-fb63-49a5-806b-a3703f98b4d1 tempest-SnapshotsActionsTest-1360144753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-249d212e-fb63-49a5-806b-a3703f98b4d1 tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed935ab-f203-41aa-98f5-1dfad72f7c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-471253965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484a82ec-c997-4f10-8d84-58fa9cb299d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40a7c0792db457abfb4d92558963bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:36Z,use_quota=True,user_id='5307a190229742f982fc584c4acf5d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:36 devstack sudo[88847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6 1G Apr 21 02:09:36 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f9ab72-1a1f-4514-b9f5-d20a53c2eb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f9ab72-1a1f-4514-b9f5-d20a53c2eb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d431ff-b1e5-407b-9464-364762e5a478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d431ff-b1e5-407b-9464-364762e5a478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '484a82ec-c997-4f10-8d84-58fa9cb299d0', 'volume_name': 'volume-484a82ec-c997-4f10-8d84-58fa9cb299d0', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd042b65-4ab0-4bcf-b608-f89fffdacb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd042b65-4ab0-4bcf-b608-f89fffdacb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83a0724-4c9c-48f1-b13a-fcf113a06baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Volume 484a82ec-c997-4f10-8d84-58fa9cb299d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-484a82ec-c997-4f10-8d84-58fa9cb299d0', 'volume_size': 1} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Flow 'volume_create_manager' (61a3eee3-1413-4e47-8170-90cc9a66febb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7568fabb-8488-4c94-a304-2d55539aea51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7568fabb-8488-4c94-a304-2d55539aea51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1161353313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e16cd3-7b12-47de-9fc6-0b145af883b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40a7c0792db457abfb4d92558963bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:37Z,use_quota=True,user_id='5307a190229742f982fc584c4acf5d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6324b6-bf4a-44fb-977a-74bda218b1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6324b6-bf4a-44fb-977a-74bda218b1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f5bf7d-454e-4b05-871a-f2a88daa54df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f5bf7d-454e-4b05-871a-f2a88daa54df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8e16cd3-7b12-47de-9fc6-0b145af883b9', 'volume_name': 'volume-c8e16cd3-7b12-47de-9fc6-0b145af883b9', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4852d8ca-7dc2-4b97-887a-106980af8070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4852d8ca-7dc2-4b97-887a-106980af8070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45449bf-dd66-4452-a26b-8ed75a208237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Volume c8e16cd3-7b12-47de-9fc6-0b145af883b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8e16cd3-7b12-47de-9fc6-0b145af883b9', 'volume_size': 1} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Flow 'volume_create_manager' (b4035f7f-7a0a-4a80-9e9c-6d66635e817c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc214eef-7021-4466-bf84-4811ad622ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc214eef-7021-4466-bf84-4811ad622ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1219353535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc41d2e3-0a6a-4f46-87cf-e87d3833ba23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40a7c0792db457abfb4d92558963bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:37Z,use_quota=True,user_id='5307a190229742f982fc584c4acf5d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1510b3e-cd8a-4204-8e93-767a0c3ec9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1510b3e-cd8a-4204-8e93-767a0c3ec9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ed0fe2-dcdb-46c5-98f5-4ede9a4141b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ed0fe2-dcdb-46c5-98f5-4ede9a4141b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc41d2e3-0a6a-4f46-87cf-e87d3833ba23', 'volume_name': 'volume-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9094d1-7c92-4b39-bc9d-c59e0e2df479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9094d1-7c92-4b39-bc9d-c59e0e2df479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7184e7b-7bdb-4a8d-a404-9e3d6971af1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:36 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Volume dc41d2e3-0a6a-4f46-87cf-e87d3833ba23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23', 'volume_size': 1} Apr 21 02:09:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:37 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:09:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Flow 'volume_create_manager' (35f130d2-6192-4176-a1ba-476044d38b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb722f3-440a-4fa4-b35f-19b434aa589e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb722f3-440a-4fa4-b35f-19b434aa589e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1834870529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40a7c0792db457abfb4d92558963bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:37Z,use_quota=True,user_id='5307a190229742f982fc584c4acf5d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8b376d-ff18-4b27-9f84-23140732b42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8b376d-ff18-4b27-9f84-23140732b42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9416790e-1367-49de-abc0-e204b6d9bd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9416790e-1367-49de-abc0-e204b6d9bd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27', 'volume_name': 'volume-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84bbb5c4-8d36-441b-8d69-a4e803c8d067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84bbb5c4-8d36-441b-8d69-a4e803c8d067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbc9ef8-e2f9-4893-8513-50d2da83d48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:37 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Volume 2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27', 'volume_size': 1} Apr 21 02:09:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:37 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-249d212e-fb63-49a5-806b-a3703f98b4d1 tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6 1G" returned: 0 in 0.601s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-249d212e-fb63-49a5-806b-a3703f98b4d1 tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:37 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6 Apr 21 02:09:37 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:37 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-249d212e-fb63-49a5-806b-a3703f98b4d1 tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6" returned: 0 in 0.416s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:37 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-249d212e-fb63-49a5-806b-a3703f98b4d1 tempest-SnapshotsActionsTest-1360144753 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6 is being set with open permissions: ugo+rw Apr 21 02:09:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-249d212e-fb63-49a5-806b-a3703f98b4d1 tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:37 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6 Apr 21 02:09:37 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:37 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-249d212e-fb63-49a5-806b-a3703f98b4d1 tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6" returned: 0 in 0.395s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-249d212e-fb63-49a5-806b-a3703f98b4d1 tempest-SnapshotsActionsTest-1360144753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.988s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.591s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1260781863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=849856e9-eec0-4506-8163-c7ac660a5976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40a7c0792db457abfb4d92558963bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:36Z,use_quota=True,user_id='5307a190229742f982fc584c4acf5d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Creating volume 849856e9-eec0-4506-8163-c7ac660a5976 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:09:38 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-849856e9-eec0-4506-8163-c7ac660a5976 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:38 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-849856e9-eec0-4506-8163-c7ac660a5976 1073741824 Apr 21 02:09:38 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-249d212e-fb63-49a5-806b-a3703f98b4d1 tempest-SnapshotsActionsTest-1360144753 None] Create snapshot completed successfully Apr 21 02:09:38 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] Acquiring lock "cinder-c0d5f23a-e240-4755-b1cd-8c0f0dd060b6-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-c0d5f23a-e240-4755-b1cd-8c0f0dd060b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] Acquiring lock "cinder-quobyte-c7ec75d3-1966-4b53-830c-e900fd81bb0e" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-quobyte-c7ec75d3-1966-4b53-830c-e900fd81bb0e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] Acquiring lock "cinder-quobyte-c0d5f23a-e240-4755-b1cd-8c0f0dd060b6" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-quobyte-c0d5f23a-e240-4755-b1cd-8c0f0dd060b6" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] Deleting offline snapshot c0d5f23a-e240-4755-b1cd-8c0f0dd060b6 of volume c7ec75d3-1966-4b53-830c-e900fd81bb0e {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] snapshot_file for this snap is: volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[13084912-7f4c-4844-aca8-059d4e072e30]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:38 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6 Apr 21 02:09:38 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:38 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-849856e9-eec0-4506-8163-c7ac660a5976 1073741824" returned: 0 in 0.505s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-849856e9-eec0-4506-8163-c7ac660a5976 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:38 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-849856e9-eec0-4506-8163-c7ac660a5976 Apr 21 02:09:38 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:38 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6" returned: 0 in 0.485s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc810970-e835-4a11-9d2b-417c4bbc3925]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_service.periodic_task [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:38 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:09:38 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:38 devstack sudo[88872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be Apr 21 02:09:38 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:38 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-849856e9-eec0-4506-8163-c7ac660a5976" returned: 0 in 0.415s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.343s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-471253965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484a82ec-c997-4f10-8d84-58fa9cb299d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40a7c0792db457abfb4d92558963bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:36Z,use_quota=True,user_id='5307a190229742f982fc584c4acf5d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Creating volume 484a82ec-c997-4f10-8d84-58fa9cb299d0 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:09:38 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-484a82ec-c997-4f10-8d84-58fa9cb299d0 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7e33e0-c23e-4f91-9b79-b01b2d35e3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-849856e9-eec0-4506-8163-c7ac660a5976', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:38 devstack sudo[88877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-484a82ec-c997-4f10-8d84-58fa9cb299d0 1073741824 Apr 21 02:09:38 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce7a1efd-a2d0-4ad0-85b0-e01c7006aa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:39 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Volume volume-849856e9-eec0-4506-8163-c7ac660a5976 (849856e9-eec0-4506-8163-c7ac660a5976): created successfully Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce7a1efd-a2d0-4ad0-85b0-e01c7006aa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Flow 'volume_create_manager' (5026a543-60f1-453c-ad3f-c28048317f23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:39 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-51338dd3-4145-4dc2-8589-be40ebe02c34 tempest-CreateVolumesFromImageTest-177183755 None] Created volume successfully. Apr 21 02:09:39 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.436s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:09:39 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be" returned: 0 in 0.526s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:39 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6 Apr 21 02:09:39 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:39 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-484a82ec-c997-4f10-8d84-58fa9cb299d0 1073741824" returned: 0 in 0.501s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-484a82ec-c997-4f10-8d84-58fa9cb299d0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:39 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-484a82ec-c997-4f10-8d84-58fa9cb299d0 Apr 21 02:09:39 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:39 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6" returned: 0 in 0.470s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:39 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6 Apr 21 02:09:39 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:39 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-484a82ec-c997-4f10-8d84-58fa9cb299d0" returned: 0 in 0.438s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.157s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1161353313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e16cd3-7b12-47de-9fc6-0b145af883b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40a7c0792db457abfb4d92558963bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:37Z,use_quota=True,user_id='5307a190229742f982fc584c4acf5d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Creating volume c8e16cd3-7b12-47de-9fc6-0b145af883b9 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:09:39 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c8e16cd3-7b12-47de-9fc6-0b145af883b9 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:39 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c8e16cd3-7b12-47de-9fc6-0b145af883b9 1073741824 Apr 21 02:09:39 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83a0724-4c9c-48f1-b13a-fcf113a06baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-484a82ec-c997-4f10-8d84-58fa9cb299d0', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce624d6d-79b2-4785-aa1f-51c0519b2d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:39 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Volume volume-484a82ec-c997-4f10-8d84-58fa9cb299d0 (484a82ec-c997-4f10-8d84-58fa9cb299d0): created successfully Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce624d6d-79b2-4785-aa1f-51c0519b2d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:39 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Flow 'volume_create_manager' (bd80bd90-82ab-4029-8c4b-1d3ecb463fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:40 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-42780032-a867-427e-8aa0-c6487fb1a8cc tempest-CreateVolumesFromImageTest-177183755 None] Created volume successfully. Apr 21 02:09:40 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.c0d5f23a-e240-4755-b1cd-8c0f0dd060b6" returned: 0 in 0.411s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-quobyte-c0d5f23a-e240-4755-b1cd-8c0f0dd060b6" released by "_delete_snapshot" :: held 1.937s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-quobyte-c7ec75d3-1966-4b53-830c-e900fd81bb0e" released by "delete_snapshot" :: held 1.950s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] Created reservations ['956738e8-2c9a-4a46-8b11-b508cf4b0e08', '2618a03f-42aa-482a-98b7-e431bfd92f5f', '533f1b66-1e16-4683-8b47-659bae9c2f32', 'e9fb9483-33dd-4c2e-8b5f-2285dbba5b2e'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:40 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] Delete snapshot completed successfully. Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3baea90e-a1a1-4b20-8a10-8abbd7c73024 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-c0d5f23a-e240-4755-b1cd-8c0f0dd060b6-delete_snapshot" released by "delete_snapshot" :: held 2.036s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-da8296c0-f8fb-4b36-8f9e-826ca51afe9f tempest-SnapshotsActionsTest-1360144753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:40 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c8e16cd3-7b12-47de-9fc6-0b145af883b9 1073741824" returned: 0 in 0.558s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c8e16cd3-7b12-47de-9fc6-0b145af883b9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:40 devstack sudo[88902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c8e16cd3-7b12-47de-9fc6-0b145af883b9 Apr 21 02:09:40 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:40 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c8e16cd3-7b12-47de-9fc6-0b145af883b9" returned: 0 in 0.400s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.976s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1219353535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc41d2e3-0a6a-4f46-87cf-e87d3833ba23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40a7c0792db457abfb4d92558963bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:37Z,use_quota=True,user_id='5307a190229742f982fc584c4acf5d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Creating volume dc41d2e3-0a6a-4f46-87cf-e87d3833ba23 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:09:40 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45449bf-dd66-4452-a26b-8ed75a208237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8e16cd3-7b12-47de-9fc6-0b145af883b9', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:40 devstack sudo[88905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23 1073741824 Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47803337-a747-4ff1-9d1c-9ffeb85f5651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:40 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:40 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Volume volume-c8e16cd3-7b12-47de-9fc6-0b145af883b9 (c8e16cd3-7b12-47de-9fc6-0b145af883b9): created successfully Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47803337-a747-4ff1-9d1c-9ffeb85f5651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:40 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Flow 'volume_create_manager' (61a3eee3-1413-4e47-8170-90cc9a66febb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:40 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-7c6e5688-84e2-4535-98f3-f1c6780f3379 tempest-CreateVolumesFromImageTest-177183755 None] Created volume successfully. Apr 21 02:09:41 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23 1073741824" returned: 0 in 0.486s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:41 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23 Apr 21 02:09:41 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:41 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23" returned: 0 in 0.397s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.722s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1834870529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40a7c0792db457abfb4d92558963bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:37Z,use_quota=True,user_id='5307a190229742f982fc584c4acf5d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Creating volume 2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:09:41 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7184e7b-7bdb-4a8d-a404-9e3d6971af1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2fd775-918b-4cca-bb13-422cf5393700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:41 devstack sudo[88913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27 1073741824 Apr 21 02:09:41 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:41 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Volume volume-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23 (dc41d2e3-0a6a-4f46-87cf-e87d3833ba23): created successfully Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2fd775-918b-4cca-bb13-422cf5393700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Flow 'volume_create_manager' (b4035f7f-7a0a-4a80-9e9c-6d66635e817c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:41 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-2e3ce5cb-a556-42e0-8c22-3113362c6f67 tempest-CreateVolumesFromImageTest-177183755 None] Created volume successfully. Apr 21 02:09:42 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27 1073741824" returned: 0 in 0.468s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:42 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27 Apr 21 02:09:42 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:42 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27" returned: 0 in 0.398s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:09:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-da8296c0-f8fb-4b36-8f9e-826ca51afe9f tempest-SnapshotsActionsTest-1360144753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.263s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbc9ef8-e2f9-4893-8513-50d2da83d48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f2480d-28e8-4396-9133-df3e79815e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:42 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Volume volume-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27 (2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27): created successfully Apr 21 02:09:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f2480d-28e8-4396-9133-df3e79815e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Flow 'volume_create_manager' (35f130d2-6192-4176-a1ba-476044d38b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-da8296c0-f8fb-4b36-8f9e-826ca51afe9f tempest-SnapshotsActionsTest-1360144753 None] Creating offline snapshot 72d285dc-b38f-4b55-a264-9cc1822315a2 of volume c7ec75d3-1966-4b53-830c-e900fd81bb0e {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:09:42 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-0f990834-bd78-45bf-a6eb-0bc533f60568 tempest-CreateVolumesFromImageTest-177183755 None] Created volume successfully. Apr 21 02:09:42 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1e9e32-709e-4436-a20b-d04af17db5ec]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-da8296c0-f8fb-4b36-8f9e-826ca51afe9f tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:42 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be Apr 21 02:09:42 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:43 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-da8296c0-f8fb-4b36-8f9e-826ca51afe9f tempest-SnapshotsActionsTest-1360144753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be" returned: 0 in 0.457s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-da8296c0-f8fb-4b36-8f9e-826ca51afe9f tempest-SnapshotsActionsTest-1360144753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-da8296c0-f8fb-4b36-8f9e-826ca51afe9f tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:43 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2 1G Apr 21 02:09:43 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "cinder-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "cinder-quobyte-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-quobyte-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:43 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cbac50-380f-4112-846b-6f50a8e57b8c]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:43 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27 Apr 21 02:09:43 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:43 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-da8296c0-f8fb-4b36-8f9e-826ca51afe9f tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2 1G" returned: 0 in 0.505s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-da8296c0-f8fb-4b36-8f9e-826ca51afe9f tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:43 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2 Apr 21 02:09:43 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:44 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27" returned: 0 in 0.484s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:44 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27 Apr 21 02:09:44 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:44 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-da8296c0-f8fb-4b36-8f9e-826ca51afe9f tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2" returned: 0 in 0.427s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:44 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-da8296c0-f8fb-4b36-8f9e-826ca51afe9f tempest-SnapshotsActionsTest-1360144753 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2 is being set with open permissions: ugo+rw Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-da8296c0-f8fb-4b36-8f9e-826ca51afe9f tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:44 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2 Apr 21 02:09:44 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:44 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27" returned: 0 in 0.413s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-quobyte-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27" released by "delete_volume" :: held 0.919s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] Created reservations ['fea70051-d888-4568-bc60-b7998384d323', 'c507354f-3187-4761-8cdf-f9b6ae1cc634', '5b179623-31a6-4b75-9bb2-471b8a5a4177', '12bec051-6ed9-4a87-a595-a2588c2bd892'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:44 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:09:44 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:44 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-da8296c0-f8fb-4b36-8f9e-826ca51afe9f tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2" returned: 0 in 0.414s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-da8296c0-f8fb-4b36-8f9e-826ca51afe9f tempest-SnapshotsActionsTest-1360144753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:44 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-da8296c0-f8fb-4b36-8f9e-826ca51afe9f tempest-SnapshotsActionsTest-1360144753 None] Create snapshot completed successfully Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "cinder-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "cinder-quobyte-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-quobyte-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb26673-d246-4c43-80c1-437117b7fae2]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:44 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23 Apr 21 02:09:44 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:44 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.401s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:44 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:09:44 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] Deleted volume successfully. Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ddbf95cd-ae59-4c59-be1e-b229f3745dc9 tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-2da06ba7-e4c8-4c88-bda4-1ba5f4cb1e27-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:45 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23" returned: 0 in 0.480s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:45 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23 Apr 21 02:09:45 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:45 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23" returned: 0 in 0.410s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-quobyte-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23" released by "delete_volume" :: held 0.914s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] Created reservations ['2894606d-3b90-4b29-98dd-06d4a980bea5', '66d69edf-83e0-41cb-87e1-2c138a39371a', '8044b2e3-555b-441e-998d-2a76809bc116', 'ffab4a04-e917-42bc-bef9-fcd34c8678b9'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] Acquiring lock "cinder-72d285dc-b38f-4b55-a264-9cc1822315a2-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-72d285dc-b38f-4b55-a264-9cc1822315a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] Acquiring lock "cinder-quobyte-c7ec75d3-1966-4b53-830c-e900fd81bb0e" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-quobyte-c7ec75d3-1966-4b53-830c-e900fd81bb0e" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] Acquiring lock "cinder-quobyte-72d285dc-b38f-4b55-a264-9cc1822315a2" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-quobyte-72d285dc-b38f-4b55-a264-9cc1822315a2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] Deleting offline snapshot 72d285dc-b38f-4b55-a264-9cc1822315a2 of volume c7ec75d3-1966-4b53-830c-e900fd81bb0e {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] snapshot_file for this snap is: volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f794009d-6745-4121-98a3-4aabf1729d1a]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "cinder-c8e16cd3-7b12-47de-9fc6-0b145af883b9-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:45 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:09:45 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-c8e16cd3-7b12-47de-9fc6-0b145af883b9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:45 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2 Apr 21 02:09:45 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "cinder-quobyte-c8e16cd3-7b12-47de-9fc6-0b145af883b9" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-quobyte-c8e16cd3-7b12-47de-9fc6-0b145af883b9" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a2be95-150f-4619-a750-768418ccdc17]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c8e16cd3-7b12-47de-9fc6-0b145af883b9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:45 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c8e16cd3-7b12-47de-9fc6-0b145af883b9 Apr 21 02:09:45 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:46 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.438s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:09:46 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] Deleted volume successfully. Apr 21 02:09:46 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-680ad98a-f466-4b03-9415-1060a1c2e402 tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-dc41d2e3-0a6a-4f46-87cf-e87d3833ba23-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2" returned: 0 in 0.476s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d304eabb-ad8a-4d49-b9bd-589a1d891384]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:46 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be Apr 21 02:09:46 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:46 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c8e16cd3-7b12-47de-9fc6-0b145af883b9" returned: 0 in 0.482s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c8e16cd3-7b12-47de-9fc6-0b145af883b9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:46 devstack sudo[88974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c8e16cd3-7b12-47de-9fc6-0b145af883b9 Apr 21 02:09:46 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:46 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be" returned: 0 in 0.471s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:46 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c8e16cd3-7b12-47de-9fc6-0b145af883b9" returned: 0 in 0.410s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:46 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2 Apr 21 02:09:46 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-quobyte-c8e16cd3-7b12-47de-9fc6-0b145af883b9" released by "delete_volume" :: held 0.913s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] Created reservations ['8d72b7eb-16bc-49bc-b0f6-3c1cf1c45e38', '8cd82444-0677-43ac-9a05-b89eed467bad', '11296886-2d6c-4366-b398-36e6c735f765', '544285aa-ec49-43da-bf52-986381b5e4a1'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:46 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:09:46 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "cinder-484a82ec-c997-4f10-8d84-58fa9cb299d0-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-484a82ec-c997-4f10-8d84-58fa9cb299d0-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "cinder-quobyte-484a82ec-c997-4f10-8d84-58fa9cb299d0" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-quobyte-484a82ec-c997-4f10-8d84-58fa9cb299d0" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0934b6e5-ccfb-4124-9f2d-891edeff4040]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-484a82ec-c997-4f10-8d84-58fa9cb299d0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:47 devstack sudo[88984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-484a82ec-c997-4f10-8d84-58fa9cb299d0 Apr 21 02:09:47 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:47 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2" returned: 0 in 0.482s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:47 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2 Apr 21 02:09:47 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:47 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.431s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:47 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:09:47 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] Deleted volume successfully. Apr 21 02:09:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b6eaec06-9e7b-4ed8-9841-5841277ea1b2 tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-c8e16cd3-7b12-47de-9fc6-0b145af883b9-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:47 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-484a82ec-c997-4f10-8d84-58fa9cb299d0" returned: 0 in 0.500s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-484a82ec-c997-4f10-8d84-58fa9cb299d0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:47 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-484a82ec-c997-4f10-8d84-58fa9cb299d0 Apr 21 02:09:47 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:47 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.72d285dc-b38f-4b55-a264-9cc1822315a2" returned: 0 in 0.418s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-quobyte-72d285dc-b38f-4b55-a264-9cc1822315a2" released by "_delete_snapshot" :: held 1.895s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-quobyte-c7ec75d3-1966-4b53-830c-e900fd81bb0e" released by "delete_snapshot" :: held 1.912s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:47 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] Created reservations ['e599af02-bebe-4d05-b059-781c542e4410', 'd9418350-d9dd-4c7e-a04e-35f9409a9ddd', '0a744d73-5b45-4ccc-992b-3e0056565b02', '5d20e823-9937-421c-859c-22bf5a3f31ea'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:47 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] Delete snapshot completed successfully. Apr 21 02:09:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-074f9522-cda3-40b4-9cf2-01ebedeb3103 tempest-SnapshotsActionsTest-1394252047 None] Lock "cinder-72d285dc-b38f-4b55-a264-9cc1822315a2-delete_snapshot" released by "delete_snapshot" :: held 1.996s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:47 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-484a82ec-c997-4f10-8d84-58fa9cb299d0" returned: 0 in 0.455s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-quobyte-484a82ec-c997-4f10-8d84-58fa9cb299d0" released by "delete_volume" :: held 0.978s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:47 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] Created reservations ['e0d78594-6be7-4229-8741-bc766cc94a15', '71d649b1-4990-44b8-863a-629ff6a4fd7d', '2dc77a0b-5414-44c2-9d5b-a1e0a3b7060b', 'a68f1dee-d1fb-4d27-810f-9497aca91090'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:48 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:09:48 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "cinder-849856e9-eec0-4506-8163-c7ac660a5976-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-849856e9-eec0-4506-8163-c7ac660a5976-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] Acquiring lock "cinder-998f57ce-e6ce-40df-8800-f700c9cd67be-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "cinder-quobyte-849856e9-eec0-4506-8163-c7ac660a5976" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] Lock "cinder-998f57ce-e6ce-40df-8800-f700c9cd67be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] Acquiring lock "cinder-quobyte-c7ec75d3-1966-4b53-830c-e900fd81bb0e" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-quobyte-849856e9-eec0-4506-8163-c7ac660a5976" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] Lock "cinder-quobyte-c7ec75d3-1966-4b53-830c-e900fd81bb0e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] Acquiring lock "cinder-quobyte-998f57ce-e6ce-40df-8800-f700c9cd67be" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14b4beb-16b5-45cf-8c78-41329900da6e]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-849856e9-eec0-4506-8163-c7ac660a5976 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] Lock "cinder-quobyte-998f57ce-e6ce-40df-8800-f700c9cd67be" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] Deleting offline snapshot 998f57ce-e6ce-40df-8800-f700c9cd67be of volume c7ec75d3-1966-4b53-830c-e900fd81bb0e {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] snapshot_file for this snap is: volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd3af7b-7b57-4a54-b56f-3ca78cf09434]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:48 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-849856e9-eec0-4506-8163-c7ac660a5976 Apr 21 02:09:48 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:48 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be Apr 21 02:09:48 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:48 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.428s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:09:48 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] Deleted volume successfully. Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1ad6715a-a505-4e22-92fc-ced5b2a545bb tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-484a82ec-c997-4f10-8d84-58fa9cb299d0-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:48 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-849856e9-eec0-4506-8163-c7ac660a5976" returned: 0 in 0.475s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-849856e9-eec0-4506-8163-c7ac660a5976 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:48 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-849856e9-eec0-4506-8163-c7ac660a5976 Apr 21 02:09:48 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:48 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be" returned: 0 in 0.478s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fc524d-3bc0-4ca1-baed-de8a1a62f3e7]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:48 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e Apr 21 02:09:48 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:49 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-849856e9-eec0-4506-8163-c7ac660a5976" returned: 0 in 0.408s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:49 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-quobyte-849856e9-eec0-4506-8163-c7ac660a5976" released by "delete_volume" :: held 0.904s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:49 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] Created reservations ['8e530891-a660-4db5-8e14-b1103c6e2c5a', 'fd8a7daf-0df8-47fd-8022-8f3511479543', '2c3e0c96-5b75-450b-88f4-65bc18217498', 'cf056c7b-d2ff-4672-ae75-c5ddd0cb6269'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:49 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:49 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:49 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:09:49 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:49 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e" returned: 0 in 0.500s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:49 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be Apr 21 02:09:49 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:49 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.505s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:49 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:09:49 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] Deleted volume successfully. Apr 21 02:09:49 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8a47c0d1-f08f-4748-aaf5-df32e92a932a tempest-CreateVolumesFromImageTest-177183755 None] Lock "cinder-849856e9-eec0-4506-8163-c7ac660a5976-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:49 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be" returned: 0 in 0.538s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:49 devstack sudo[89035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be Apr 21 02:09:49 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:50 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e.998f57ce-e6ce-40df-8800-f700c9cd67be" returned: 0 in 0.435s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] Lock "cinder-quobyte-998f57ce-e6ce-40df-8800-f700c9cd67be" released by "_delete_snapshot" :: held 2.008s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] Lock "cinder-quobyte-c7ec75d3-1966-4b53-830c-e900fd81bb0e" released by "delete_snapshot" :: held 2.035s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] Created reservations ['0f8a1b45-37cf-4917-98e3-0910bb27c27b', 'bca1fe25-b5d6-4115-a875-95579a218eb4', '70304ae7-29a9-41e9-8b36-acb04304c4d6', '8be1cbce-43c4-4c35-a617-b9094b04d5fd'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:50 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] Delete snapshot completed successfully. Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4f656a90-6d73-48d9-ae60-a7a4f2396b1a tempest-SnapshotsActionsTest-1360144753 None] Lock "cinder-998f57ce-e6ce-40df-8800-f700c9cd67be-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Flow 'volume_create_manager' (eacd97f0-4824-4676-862a-0d7c97382098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5c5077-82e7-41b7-9d87-3fa6bd38c584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5c5077-82e7-41b7-9d87-3fa6bd38c584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-393451031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed69738-6015-45a1-b214-274778a7e5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce89b6266cd4f5eba26b7cded1a508f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:51Z,use_quota=True,user_id='f85a840bd0b843e7bd8ae09b07656178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef75f06-e909-4c17-b0dc-8e88f8e37313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef75f06-e909-4c17-b0dc-8e88f8e37313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11065309-39e4-4668-ad43-f30b2a147f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11065309-39e4-4668-ad43-f30b2a147f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed69738-6015-45a1-b214-274778a7e5e7', 'volume_name': 'volume-1ed69738-6015-45a1-b214-274778a7e5e7', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1862cde7-eed9-48f7-9669-05409ea70aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1862cde7-eed9-48f7-9669-05409ea70aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f0276a-e175-49b6-839f-5df2267a4e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:50 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Volume 1ed69738-6015-45a1-b214-274778a7e5e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed69738-6015-45a1-b214-274778a7e5e7', 'volume_size': 1} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-393451031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed69738-6015-45a1-b214-274778a7e5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce89b6266cd4f5eba26b7cded1a508f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:51Z,use_quota=True,user_id='f85a840bd0b843e7bd8ae09b07656178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Creating volume 1ed69738-6015-45a1-b214-274778a7e5e7 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:09:50 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:09:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:50 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 1073741824 Apr 21 02:09:50 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:51 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:51 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] Acquiring lock "cinder-c7ec75d3-1966-4b53-830c-e900fd81bb0e-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 1073741824" returned: 0 in 0.488s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:51 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] Lock "cinder-c7ec75d3-1966-4b53-830c-e900fd81bb0e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:51 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] Acquiring lock "cinder-quobyte-c7ec75d3-1966-4b53-830c-e900fd81bb0e" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:51 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] Lock "cinder-quobyte-c7ec75d3-1966-4b53-830c-e900fd81bb0e" acquired by "delete_volume" :: waited 0.021s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:51 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 Apr 21 02:09:51 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:51 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb02447-cc3c-411c-bb62-9ba8f7ef0825]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:51 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e Apr 21 02:09:51 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:51 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7" returned: 0 in 0.437s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:51 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:09:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f0276a-e175-49b6-839f-5df2267a4e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed69738-6015-45a1-b214-274778a7e5e7', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d680a1ab-1e09-41fc-b3b5-5162e88dad0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:51 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Volume volume-1ed69738-6015-45a1-b214-274778a7e5e7 (1ed69738-6015-45a1-b214-274778a7e5e7): created successfully Apr 21 02:09:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d680a1ab-1e09-41fc-b3b5-5162e88dad0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:51 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Flow 'volume_create_manager' (eacd97f0-4824-4676-862a-0d7c97382098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:51 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-af221280-0e99-4f08-8efa-e91f7b30273d tempest-VolumeDependencyTests-1425439664 None] Created volume successfully. Apr 21 02:09:51 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e" returned: 0 in 0.499s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:51 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e Apr 21 02:09:51 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:52 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c7ec75d3-1966-4b53-830c-e900fd81bb0e" returned: 0 in 0.407s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:52 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] Lock "cinder-quobyte-c7ec75d3-1966-4b53-830c-e900fd81bb0e" released by "delete_volume" :: held 0.935s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:52 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] Created reservations ['3ad3a8fd-2a4a-4123-940b-8a78798cd4c4', '26866fda-9700-4307-87c6-16d885146b79', '36bcbc9c-54d5-453a-b044-b11c74ad72cf', 'edec471b-9da9-4060-a9ee-abe805568f7a'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:09:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:52 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:52 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:52 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:09:52 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:52 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.443s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:52 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:09:52 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] Deleted volume successfully. Apr 21 02:09:52 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-90bb0965-d659-4ad1-91e2-79e8a939e500 tempest-SnapshotsActionsTest-1360144753 None] Lock "cinder-c7ec75d3-1966-4b53-830c-e900fd81bb0e-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:09:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:53 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] Creating offline snapshot 11eacea3-f755-4640-920f-55f7b706afd1 of volume 1ed69738-6015-45a1-b214-274778a7e5e7 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:09:53 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c0651d-aaa3-407a-8693-efb3953533ad]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:53 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 Apr 21 02:09:53 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:53 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7" returned: 0 in 0.532s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:53 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1 1G Apr 21 02:09:53 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:54 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1 1G" returned: 0 in 0.550s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed69738-6015-45a1-b214-274778a7e5e7 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:54 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed69738-6015-45a1-b214-274778a7e5e7 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1 Apr 21 02:09:54 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:54 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed69738-6015-45a1-b214-274778a7e5e7 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1" returned: 0 in 0.439s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:54 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1 is being set with open permissions: ugo+rw Apr 21 02:09:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:54 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1 Apr 21 02:09:54 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:54 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1" returned: 0 in 0.453s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:55 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.info Apr 21 02:09:55 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:55 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.info" returned: 0 in 0.428s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:55 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.info is being set with open permissions: ugo+rw Apr 21 02:09:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:55 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.info Apr 21 02:09:55 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:55 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.info" returned: 0 in 0.484s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.944s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:55 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-7aa36e2c-97e9-4c9d-9f7a-daa12bdbb441 tempest-VolumeDependencyTests-1425439664 None] Create snapshot completed successfully Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Flow 'volume_create_manager' (42882470-3fd0-47e6-8488-c165364e1c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5844ef90-6de1-42bd-8177-59d0a2e724d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5844ef90-6de1-42bd-8177-59d0a2e724d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-955379133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb05775-33e4-4e22-b19a-94990a23d0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce89b6266cd4f5eba26b7cded1a508f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=11eacea3-f755-4640-920f-55f7b706afd1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:56Z,use_quota=True,user_id='f85a840bd0b843e7bd8ae09b07656178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef091a04-1c40-42b2-968c-83845fabfe93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef091a04-1c40-42b2-968c-83845fabfe93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0795786-83db-488e-a2eb-f80bfb5280ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0795786-83db-488e-a2eb-f80bfb5280ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ffb05775-33e4-4e22-b19a-94990a23d0bb', 'volume_name': 'volume-ffb05775-33e4-4e22-b19a-94990a23d0bb', 'volume_size': 1, 'snapshot_id': '11eacea3-f755-4640-920f-55f7b706afd1'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02eac9bb-ac9a-4e28-862f-2775570afd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02eac9bb-ac9a-4e28-862f-2775570afd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180c08cc-b473-4374-a63b-f76399c951f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:56 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Volume ffb05775-33e4-4e22-b19a-94990a23d0bb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ffb05775-33e4-4e22-b19a-94990a23d0bb', 'volume_size': 1, 'snapshot_id': '11eacea3-f755-4640-920f-55f7b706afd1'} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "cinder-quobyte-11eacea3-f755-4640-920f-55f7b706afd1-ffb05775-33e4-4e22-b19a-94990a23d0bb" by "_create_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-11eacea3-f755-4640-920f-55f7b706afd1-ffb05775-33e4-4e22-b19a-94990a23d0bb" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Creating volume ffb05775-33e4-4e22-b19a-94990a23d0bb from snapshot 11eacea3-f755-4640-920f-55f7b706afd1 {{(pid=82184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "cinder-quobyte-ffb05775-33e4-4e22-b19a-94990a23d0bb" by "_copy_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-ffb05775-33e4-4e22-b19a-94990a23d0bb" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] snapshot: 11eacea3-f755-4640-920f-55f7b706afd1, volume: ffb05775-33e4-4e22-b19a-94990a23d0bb, {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[442b1a18-d77b-4f4d-894e-3a782c8f695d]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:56 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1 Apr 21 02:09:56 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:57 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1" returned: 0 in 0.536s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:57 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ed69738-6015-45a1-b214-274778a7e5e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:09:57 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 02:09:57 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Creating direct copy from snapshot {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 02:09:57 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[719f8a0f-b9fc-48b1-9bbd-938138b6a460]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:57 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 Apr 21 02:09:57 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:57 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7" returned: 0 in 0.523s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:57 devstack cinder-volume[82184]: DEBUG cinder.utils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Path /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ffb05775-33e4-4e22-b19a-94990a23d0bb not found in is_blk_device check {{(pid=82184) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 02:09:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ffb05775-33e4-4e22-b19a-94990a23d0bb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:57 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ffb05775-33e4-4e22-b19a-94990a23d0bb Apr 21 02:09:57 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:09:58 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:09:58 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Flow 'volume_create_manager' (daaf88ec-d4f2-48d6-8f17-2fe9ed9874f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:09:58 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b95c4e0-8be8-4e93-a839-1f5ff71ef2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:58 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b95c4e0-8be8-4e93-a839-1f5ff71ef2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2076369917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b254fe-f418-4fa0-9f26-457e140c797f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='555f3016e08a438fb278431a41dc12eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:58Z,use_quota=True,user_id='8139ff5e979e4fba91835c7a7cd9b0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d20bed5d-5eb8-4b97-af1a-8e69bf3c3808),volume_type_id=d20bed5d-5eb8-4b97-af1a-8e69bf3c3808)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:58 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb538fd-3b72-48cf-9f59-bc6a7475cb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:58 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb538fd-3b72-48cf-9f59-bc6a7475cb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:58 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e6d982-7f11-4bec-b92e-7e0874748f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:58 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e6d982-7f11-4bec-b92e-7e0874748f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42b254fe-f418-4fa0-9f26-457e140c797f', 'volume_name': 'volume-42b254fe-f418-4fa0-9f26-457e140c797f', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:58 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806565a7-6885-4306-8857-e555c013ed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:58 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806565a7-6885-4306-8857-e555c013ed08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:09:58 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f127d419-5015-47d9-b465-3e803d9f3164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:09:58 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Volume 42b254fe-f418-4fa0-9f26-457e140c797f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42b254fe-f418-4fa0-9f26-457e140c797f', 'volume_size': 1} Apr 21 02:09:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:09:59 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Apr 21 02:09:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ffb05775-33e4-4e22-b19a-94990a23d0bb" returned: 0 in 1.977s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:09:59 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eb35e4-b1aa-4f20-86aa-5639559d22e9]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:09:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:09:59 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 Apr 21 02:09:59 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:00 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7" returned: 0 in 0.598s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Image conversion details: src /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7, size 1024.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ffb05775-33e4-4e22-b19a-94990a23d0bb {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:10:00 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Converted 1024.00 MB image at 517.62 MB/s Apr 21 02:10:00 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ffb05775-33e4-4e22-b19a-94990a23d0bb is being set with open permissions: ugo+rw Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ffb05775-33e4-4e22-b19a-94990a23d0bb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:00 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ffb05775-33e4-4e22-b19a-94990a23d0bb Apr 21 02:10:00 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:00 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ffb05775-33e4-4e22-b19a-94990a23d0bb" returned: 0 in 0.402s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-ffb05775-33e4-4e22-b19a-94990a23d0bb" released by "_copy_volume_from_snapshot" :: held 4.098s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-11eacea3-f755-4640-920f-55f7b706afd1-ffb05775-33e4-4e22-b19a-94990a23d0bb" released by "_create_volume_from_snapshot" :: held 4.118s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.127s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.262s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2076369917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b254fe-f418-4fa0-9f26-457e140c797f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='555f3016e08a438fb278431a41dc12eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:09:58Z,use_quota=True,user_id='8139ff5e979e4fba91835c7a7cd9b0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d20bed5d-5eb8-4b97-af1a-8e69bf3c3808),volume_type_id=d20bed5d-5eb8-4b97-af1a-8e69bf3c3808)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Creating volume 42b254fe-f418-4fa0-9f26-457e140c797f {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:10:00 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-42b254fe-f418-4fa0-9f26-457e140c797f 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:00 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-42b254fe-f418-4fa0-9f26-457e140c797f 1073741824 Apr 21 02:10:00 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180c08cc-b473-4374-a63b-f76399c951f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffb05775-33e4-4e22-b19a-94990a23d0bb', 'volume_size': 1, 'snapshot_id': '11eacea3-f755-4640-920f-55f7b706afd1'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef44c9a5-e625-45eb-8ce8-c16fc7fd8a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:00 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Volume volume-ffb05775-33e4-4e22-b19a-94990a23d0bb (ffb05775-33e4-4e22-b19a-94990a23d0bb): created successfully Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef44c9a5-e625-45eb-8ce8-c16fc7fd8a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Flow 'volume_create_manager' (42882470-3fd0-47e6-8488-c165364e1c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:10:00 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-a4ee0c77-0e13-47b3-8b3a-28296eab50c7 tempest-VolumeDependencyTests-1425439664 None] Created volume successfully. Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "cinder-11eacea3-f755-4640-920f-55f7b706afd1-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-11eacea3-f755-4640-920f-55f7b706afd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "cinder-quobyte-1ed69738-6015-45a1-b214-274778a7e5e7" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-1ed69738-6015-45a1-b214-274778a7e5e7" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "cinder-quobyte-11eacea3-f755-4640-920f-55f7b706afd1" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-11eacea3-f755-4640-920f-55f7b706afd1" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] Deleting offline snapshot 11eacea3-f755-4640-920f-55f7b706afd1 of volume 1ed69738-6015-45a1-b214-274778a7e5e7 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] snapshot_file for this snap is: volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fcd25a-361a-4ca9-8f8a-3b5a16aa163b]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:00 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1 Apr 21 02:10:00 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:01 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-42b254fe-f418-4fa0-9f26-457e140c797f 1073741824" returned: 0 in 0.496s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-42b254fe-f418-4fa0-9f26-457e140c797f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:01 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-42b254fe-f418-4fa0-9f26-457e140c797f Apr 21 02:10:01 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:01 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1" returned: 0 in 0.479s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ed69738-6015-45a1-b214-274778a7e5e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:10:01 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfc9dd7-052b-4d25-8a26-b2abf4f4a888]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:01 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 Apr 21 02:10:01 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:01 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-42b254fe-f418-4fa0-9f26-457e140c797f" returned: 0 in 0.402s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:10:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f127d419-5015-47d9-b465-3e803d9f3164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42b254fe-f418-4fa0-9f26-457e140c797f', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d252134b-98a2-4fcc-b51d-166cd80b3d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:01 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Volume volume-42b254fe-f418-4fa0-9f26-457e140c797f (42b254fe-f418-4fa0-9f26-457e140c797f): created successfully Apr 21 02:10:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d252134b-98a2-4fcc-b51d-166cd80b3d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Flow 'volume_create_manager' (daaf88ec-d4f2-48d6-8f17-2fe9ed9874f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:10:01 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-31b4855e-f9ad-48fd-b828-f6f7995a7cf1 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Created volume successfully. Apr 21 02:10:01 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7" returned: 0 in 0.461s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:01 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1 Apr 21 02:10:01 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:02 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1" returned: 0 in 0.436s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:02 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1 Apr 21 02:10:02 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:02 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7.11eacea3-f755-4640-920f-55f7b706afd1" returned: 0 in 0.444s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-11eacea3-f755-4640-920f-55f7b706afd1" released by "_delete_snapshot" :: held 1.879s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-1ed69738-6015-45a1-b214-274778a7e5e7" released by "delete_snapshot" :: held 1.893s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] Created reservations ['a8333840-0bb6-4f0e-96c7-d11e204bb2ba', '23e884ca-5b5b-4c33-b7a4-12ad4b13a8be', '694788ca-80e8-4fa0-bbe7-5fd96def299d', 'cabac6d7-8562-4cc8-b5cd-7bf9759b9185'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fade1b96-63a5-4a6d-a2d7-75bb0e6c6f42 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fade1b96-63a5-4a6d-a2d7-75bb0e6c6f42 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fade1b96-63a5-4a6d-a2d7-75bb0e6c6f42 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fade1b96-63a5-4a6d-a2d7-75bb0e6c6f42 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fade1b96-63a5-4a6d-a2d7-75bb0e6c6f42 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fade1b96-63a5-4a6d-a2d7-75bb0e6c6f42 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:02 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:10:02 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:02 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] Delete snapshot completed successfully. Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8172254d-d749-4cf2-91ae-6a0ea43e25f0 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-11eacea3-f755-4640-920f-55f7b706afd1-delete_snapshot" released by "delete_snapshot" :: held 2.020s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "cinder-1ed69738-6015-45a1-b214-274778a7e5e7-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-1ed69738-6015-45a1-b214-274778a7e5e7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "cinder-quobyte-1ed69738-6015-45a1-b214-274778a7e5e7" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-1ed69738-6015-45a1-b214-274778a7e5e7" acquired by "delete_volume" :: waited 0.017s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b970bf8a-d9c7-48c7-810a-dca6b256e137]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:03 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 Apr 21 02:10:03 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:03 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fade1b96-63a5-4a6d-a2d7-75bb0e6c6f42 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.457s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:03 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-fade1b96-63a5-4a6d-a2d7-75bb0e6c6f42 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:10:03 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-fade1b96-63a5-4a6d-a2d7-75bb0e6c6f42 tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Retype volume completed successfully. Apr 21 02:10:03 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7" returned: 0 in 0.479s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:03 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7 Apr 21 02:10:03 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:03 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-1ed69738-6015-45a1-b214-274778a7e5e7" returned: 0 in 0.417s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-1ed69738-6015-45a1-b214-274778a7e5e7" released by "delete_volume" :: held 0.926s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:03 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] Created reservations ['02af2c81-0949-4ada-bc88-a3603f9eb0d4', '385580c4-10e5-4789-9e73-ee4520162d8b', '393f2637-1696-4ea2-a2a1-6c25e5b2db0b', '1a6f1fa0-091a-4804-9958-93f1d6f102e1'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:10:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Acquiring lock "cinder-42b254fe-f418-4fa0-9f26-457e140c797f-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Lock "cinder-42b254fe-f418-4fa0-9f26-457e140c797f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:10:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:10:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:04 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:10:04 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Acquiring lock "cinder-quobyte-42b254fe-f418-4fa0-9f26-457e140c797f" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Lock "cinder-quobyte-42b254fe-f418-4fa0-9f26-457e140c797f" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6212913-ed81-47cb-8f67-64ee98a4f4c6]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-42b254fe-f418-4fa0-9f26-457e140c797f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:04 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-42b254fe-f418-4fa0-9f26-457e140c797f Apr 21 02:10:04 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Flow 'volume_create_manager' (73473c48-1acd-46bb-b314-8a2c078cffd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0e24ee-b13f-4bcd-b4c4-8b53f13916a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0e24ee-b13f-4bcd-b4c4-8b53f13916a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1448619442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb1571b-f8d3-4b4d-a9e7-c8de29463de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce89b6266cd4f5eba26b7cded1a508f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:10:04Z,use_quota=True,user_id='f85a840bd0b843e7bd8ae09b07656178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e172a2b0-1b6e-45da-b6d9-b20402420fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e172a2b0-1b6e-45da-b6d9-b20402420fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1206d8-bb37-4907-9d6d-6cb12ea52355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1206d8-bb37-4907-9d6d-6cb12ea52355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fb1571b-f8d3-4b4d-a9e7-c8de29463de5', 'volume_name': 'volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d71bb29-2494-4444-b2ea-bd26679d0df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d71bb29-2494-4444-b2ea-bd26679d0df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7f7cf6-c57b-4cfe-bcc1-f10de871197b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:04 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Volume 5fb1571b-f8d3-4b4d-a9e7-c8de29463de5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5', 'volume_size': 1} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1448619442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb1571b-f8d3-4b4d-a9e7-c8de29463de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce89b6266cd4f5eba26b7cded1a508f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:10:04Z,use_quota=True,user_id='f85a840bd0b843e7bd8ae09b07656178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Creating volume 5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:10:04 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:04 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 1073741824 Apr 21 02:10:04 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:04 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.440s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:10:04 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] Deleted volume successfully. Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-5aaa734d-d4b1-4dbc-8e76-110f5fce20d3 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-1ed69738-6015-45a1-b214-274778a7e5e7-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:04 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-42b254fe-f418-4fa0-9f26-457e140c797f" returned: 0 in 0.500s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-42b254fe-f418-4fa0-9f26-457e140c797f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:04 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-42b254fe-f418-4fa0-9f26-457e140c797f Apr 21 02:10:04 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:04 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 1073741824" returned: 0 in 0.483s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:04 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 Apr 21 02:10:04 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:04 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-42b254fe-f418-4fa0-9f26-457e140c797f" returned: 0 in 0.421s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Lock "cinder-quobyte-42b254fe-f418-4fa0-9f26-457e140c797f" released by "delete_volume" :: held 0.945s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:04 devstack cinder-volume[82184]: WARNING cinder.quota [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:10:04 devstack cinder-volume[82184]: WARNING cinder.quota [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 21 02:10:05 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Created reservations ['5187cdef-b00f-4de5-ab0a-c02bc2625d8a', 'd74e4150-b8ea-4141-b87e-a09e68f96603', '59ee0766-072e-47f6-a6bd-f35208b1779d', '6b5e476e-197c-4b27-83c8-7733d2c5a9ec'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:10:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:10:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:10:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:05 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:10:05 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:05 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5" returned: 0 in 0.426s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:10:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:05 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7f7cf6-c57b-4cfe-bcc1-f10de871197b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:05 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4560e8a-8e13-45be-9ce2-faa83e33d26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:05 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Volume volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 (5fb1571b-f8d3-4b4d-a9e7-c8de29463de5): created successfully Apr 21 02:10:05 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4560e8a-8e13-45be-9ce2-faa83e33d26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:05 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Flow 'volume_create_manager' (73473c48-1acd-46bb-b314-8a2c078cffd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:10:05 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-deb44fec-6257-4702-af92-4a0548204e0a tempest-VolumeDependencyTests-1425439664 None] Created volume successfully. Apr 21 02:10:05 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.412s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:05 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:10:05 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Deleted volume successfully. Apr 21 02:10:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-250ed230-98b6-4d79-88ac-c5d9a0e1d02e tempest-VolumeRetypeWithoutMigrationTest-827400461 None] Lock "cinder-42b254fe-f418-4fa0-9f26-457e140c797f-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:06 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:10:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Flow 'volume_create_manager' (e9a97148-0b4c-4904-b451-d2b811f85c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:10:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74cced97-38fa-486d-b11d-666fc68ebee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74cced97-38fa-486d-b11d-666fc68ebee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-145030765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e62a80-5012-4abe-8f7e-dc1d9410ba7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce89b6266cd4f5eba26b7cded1a508f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5fb1571b-f8d3-4b4d-a9e7-c8de29463de5,status='creating',terminated_at=None,updated_at=2026-04-21T00:10:07Z,use_quota=True,user_id='f85a840bd0b843e7bd8ae09b07656178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7970c55-3082-4e52-81fa-d04a6ec98d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7970c55-3082-4e52-81fa-d04a6ec98d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daaa9d50-e808-4f41-9bde-5a6fea6a120b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daaa9d50-e808-4f41-9bde-5a6fea6a120b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a3e62a80-5012-4abe-8f7e-dc1d9410ba7c', 'volume_name': 'volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c', 'volume_size': 1, 'source_volid': '5fb1571b-f8d3-4b4d-a9e7-c8de29463de5', 'source_volstatus': 'available'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6ce75b-13ea-45a9-8979-0888a9c3f981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6ce75b-13ea-45a9-8979-0888a9c3f981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf558672-dcf8-48b5-806a-27a64ac8967a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:06 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Volume a3e62a80-5012-4abe-8f7e-dc1d9410ba7c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c', 'volume_size': 1, 'source_volid': '5fb1571b-f8d3-4b4d-a9e7-c8de29463de5', 'source_volstatus': 'available'} Apr 21 02:10:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:06 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Cloning volume 5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 to volume a3e62a80-5012-4abe-8f7e-dc1d9410ba7c Apr 21 02:10:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Creating offline snapshot b34adeed-039a-48e2-b143-cf82c364d44d of volume 5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:10:06 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ebd08e-a970-4a86-bd26-4adb429be1f5]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:06 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 Apr 21 02:10:06 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:07 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5" returned: 0 in 0.537s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:07 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d 1G Apr 21 02:10:07 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:07 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d 1G" returned: 0 in 0.509s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:07 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d Apr 21 02:10:07 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:08 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d" returned: 0 in 0.477s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:08 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d is being set with open permissions: ugo+rw Apr 21 02:10:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:08 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d Apr 21 02:10:08 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:08 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d" returned: 0 in 0.456s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:08 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.info Apr 21 02:10:08 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Flow 'volume_create_manager' (8a5dfc96-cd9d-4050-aaa7-846253614c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101e0635-0aa7-44f5-af72-1128c9b7e208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101e0635-0aa7-44f5-af72-1128c9b7e208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-375488478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8cd055f-be92-4a20-b687-8a2918b8d764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072162fac2b849ec857800d68b0e9c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:10:09Z,use_quota=True,user_id='310ebeb7876240b19497ab2d62a4092c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4802ee-8c3c-486a-9b2a-f059acb16b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4802ee-8c3c-486a-9b2a-f059acb16b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cfd1ba5-9816-4351-88ed-65cd320f6f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cfd1ba5-9816-4351-88ed-65cd320f6f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8cd055f-be92-4a20-b687-8a2918b8d764', 'volume_name': 'volume-e8cd055f-be92-4a20-b687-8a2918b8d764', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057ece27-01bf-4878-b891-05704ac581c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057ece27-01bf-4878-b891-05704ac581c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fa15f4-93e6-40b0-b921-c7cd3ceeacd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:09 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Volume e8cd055f-be92-4a20-b687-8a2918b8d764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8cd055f-be92-4a20-b687-8a2918b8d764', 'volume_size': 1} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:09 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.info" returned: 0 in 0.446s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:09 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.info is being set with open permissions: ugo+rw Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:09 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.info Apr 21 02:10:09 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:09 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.info" returned: 0 in 0.401s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "cinder-quobyte-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c" by "_copy_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] snapshot: b34adeed-039a-48e2-b143-cf82c364d44d, volume: a3e62a80-5012-4abe-8f7e-dc1d9410ba7c, {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4788ac2e-bd90-43ca-8e1c-ec181b934973]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:09 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d Apr 21 02:10:09 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:10 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d" returned: 0 in 0.466s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:10 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:10:10 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 02:10:10 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Creating direct copy from snapshot {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 02:10:10 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[978e29f9-a2d3-44eb-830f-e4429aa882dd]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:10 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 Apr 21 02:10:10 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:10 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5" returned: 0 in 0.465s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:10 devstack cinder-volume[82184]: DEBUG cinder.utils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Path /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c not found in is_blk_device check {{(pid=82184) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 02:10:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:10 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c Apr 21 02:10:10 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:12 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c" returned: 0 in 1.878s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:12 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[420ae48b-8341-43cb-ad35-8b7f21858252]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:12 devstack sudo[89254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 Apr 21 02:10:12 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:13 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5" returned: 0 in 0.596s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:13 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Image conversion details: src /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5, size 1024.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:10:13 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Converted 1024.00 MB image at 544.78 MB/s Apr 21 02:10:13 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c is being set with open permissions: ugo+rw Apr 21 02:10:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:13 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c Apr 21 02:10:13 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:13 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c" returned: 0 in 0.400s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:13 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c" released by "_copy_volume_from_snapshot" :: held 3.848s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:13 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:SELECT=146,cinder:UPDATE=190,cinder:INSERT=47,cinder:DELETE=14 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:10:13 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "cinder-quobyte-b34adeed-039a-48e2-b143-cf82c364d44d" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:13 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-b34adeed-039a-48e2-b143-cf82c364d44d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:13 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Deleting offline snapshot b34adeed-039a-48e2-b143-cf82c364d44d of volume 5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:10:13 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] snapshot_file for this snap is: volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:10:13 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc93910-81ff-4795-ac73-8fcc67197ade]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:13 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d Apr 21 02:10:13 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:14 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d" returned: 0 in 0.467s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:10:14 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[48459b7c-ad19-413a-a118-cfc625591953]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:14 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 Apr 21 02:10:14 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:14 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5" returned: 0 in 0.485s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:14 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d Apr 21 02:10:14 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:14 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d" returned: 0 in 0.452s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:14 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d Apr 21 02:10:14 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:15 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5.b34adeed-039a-48e2-b143-cf82c364d44d" returned: 0 in 0.413s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-b34adeed-039a-48e2-b143-cf82c364d44d" released by "_delete_snapshot" :: held 1.860s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:SELECT=164,cinder:UPDATE=175,cinder:DELETE=15,cinder:INSERT=48 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.651s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.283s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-375488478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8cd055f-be92-4a20-b687-8a2918b8d764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072162fac2b849ec857800d68b0e9c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:10:09Z,use_quota=True,user_id='310ebeb7876240b19497ab2d62a4092c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Creating volume e8cd055f-be92-4a20-b687-8a2918b8d764 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:10:15 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e8cd055f-be92-4a20-b687-8a2918b8d764 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf558672-dcf8-48b5-806a-27a64ac8967a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c', 'volume_size': 1, 'source_volid': '5fb1571b-f8d3-4b4d-a9e7-c8de29463de5', 'source_volstatus': 'available'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:15 devstack sudo[89281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e8cd055f-be92-4a20-b687-8a2918b8d764 1073741824 Apr 21 02:10:15 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d237e4b-8788-4bbf-963e-4681b8bf4bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:15 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Volume volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c (a3e62a80-5012-4abe-8f7e-dc1d9410ba7c): created successfully Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d237e4b-8788-4bbf-963e-4681b8bf4bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Flow 'volume_create_manager' (e9a97148-0b4c-4904-b451-d2b811f85c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:10:15 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-7600e475-0fab-4eda-ad8a-05f53d69232b tempest-VolumeDependencyTests-1425439664 None] Created volume successfully. Apr 21 02:10:15 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e8cd055f-be92-4a20-b687-8a2918b8d764 1073741824" returned: 0 in 0.476s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e8cd055f-be92-4a20-b687-8a2918b8d764 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:15 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e8cd055f-be92-4a20-b687-8a2918b8d764 Apr 21 02:10:15 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:16 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e8cd055f-be92-4a20-b687-8a2918b8d764" returned: 0 in 0.403s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fa15f4-93e6-40b0-b921-c7cd3ceeacd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8cd055f-be92-4a20-b687-8a2918b8d764', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14d02c0-57ba-4bdd-ac1d-3e2a118d3fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:16 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Volume volume-e8cd055f-be92-4a20-b687-8a2918b8d764 (e8cd055f-be92-4a20-b687-8a2918b8d764): created successfully Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14d02c0-57ba-4bdd-ac1d-3e2a118d3fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Flow 'volume_create_manager' (8a5dfc96-cd9d-4050-aaa7-846253614c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:10:16 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-40afe457-f69b-4918-aa98-15a06d8ffddb tempest-VolumesServicesTestJSON-686111249 None] Created volume successfully. Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "cinder-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "cinder-quobyte-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e6456f-c43a-40e9-80b3-0346f1d44594]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:16 devstack sudo[89289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 Apr 21 02:10:16 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] Acquiring lock "cinder-e8cd055f-be92-4a20-b687-8a2918b8d764-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] Lock "cinder-e8cd055f-be92-4a20-b687-8a2918b8d764-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] Acquiring lock "cinder-quobyte-e8cd055f-be92-4a20-b687-8a2918b8d764" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] Lock "cinder-quobyte-e8cd055f-be92-4a20-b687-8a2918b8d764" acquired by "delete_volume" :: waited 0.017s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[688e2a9b-780c-43ae-a7e8-763eab575e30]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e8cd055f-be92-4a20-b687-8a2918b8d764 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:16 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e8cd055f-be92-4a20-b687-8a2918b8d764 Apr 21 02:10:16 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:16 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5" returned: 0 in 0.494s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:16 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5 Apr 21 02:10:17 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:17 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e8cd055f-be92-4a20-b687-8a2918b8d764" returned: 0 in 0.496s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e8cd055f-be92-4a20-b687-8a2918b8d764 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:17 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e8cd055f-be92-4a20-b687-8a2918b8d764 Apr 21 02:10:17 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:17 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5" returned: 0 in 0.420s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5" released by "delete_volume" :: held 0.951s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] Created reservations ['f68cb284-0cde-463c-9fdd-be0c33e2b142', '8f5ede5e-4e8f-40ac-83fa-ea1aee9221de', '07dbeff2-673f-4087-916c-5ef640e05b49', '3a313fca-5eea-4aa8-a7ef-b7188bff99d6'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:17 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:10:17 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "cinder-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "cinder-quobyte-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b00e995-b174-48d4-b19b-57967080273b]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:17 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c Apr 21 02:10:17 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:17 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e8cd055f-be92-4a20-b687-8a2918b8d764" returned: 0 in 0.430s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] Lock "cinder-quobyte-e8cd055f-be92-4a20-b687-8a2918b8d764" released by "delete_volume" :: held 0.948s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] Created reservations ['03544a1b-2d5e-475e-8ee5-283ff42235e7', '4c280f3a-e6e1-4893-8c64-d4379f928d75', 'a5e6c378-01be-462f-85ba-a22f54d4037f', 'f478da2c-c9ce-42e9-8b6a-c8efc080b783'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:17 devstack sudo[89309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:10:17 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:17 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.482s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:10:17 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] Deleted volume successfully. Apr 21 02:10:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-aa7ee023-cca9-4dff-a825-82f0fce88ba5 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-5fb1571b-f8d3-4b4d-a9e7-c8de29463de5-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:18 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c" returned: 0 in 0.584s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:18 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c Apr 21 02:10:18 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:18 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.428s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:18 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:10:18 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] Deleted volume successfully. Apr 21 02:10:18 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2dda3986-001b-4d43-bb14-91ad01f281b2 tempest-VolumesServicesTestJSON-686111249 None] Lock "cinder-e8cd055f-be92-4a20-b687-8a2918b8d764-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:18 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c" returned: 0 in 0.458s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:18 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c" released by "delete_volume" :: held 1.063s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:18 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] Created reservations ['4eb37640-905a-4dd1-8359-0ac0700bbb30', 'd820b91d-cc45-46d4-90a8-a9495fb422b4', 'b9cca7a3-9c58-4817-94e5-c1f04d16c44b', '507e4509-8194-418f-a6bb-322be53adac6'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:10:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:10:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:10:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:18 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:10:18 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:19 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.426s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:19 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:10:19 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] Deleted volume successfully. Apr 21 02:10:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-7cf62f97-ecd7-46d5-ad8f-bc4cec8375fb tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-a3e62a80-5012-4abe-8f7e-dc1d9410ba7c-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "cinder-ffb05775-33e4-4e22-b19a-94990a23d0bb-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-ffb05775-33e4-4e22-b19a-94990a23d0bb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "cinder-quobyte-ffb05775-33e4-4e22-b19a-94990a23d0bb" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-ffb05775-33e4-4e22-b19a-94990a23d0bb" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:19 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6fedcf-6d51-48b9-a13e-8f8af200de88]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ffb05775-33e4-4e22-b19a-94990a23d0bb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:19 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ffb05775-33e4-4e22-b19a-94990a23d0bb Apr 21 02:10:19 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:20 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ffb05775-33e4-4e22-b19a-94990a23d0bb" returned: 0 in 0.526s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ffb05775-33e4-4e22-b19a-94990a23d0bb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:20 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ffb05775-33e4-4e22-b19a-94990a23d0bb Apr 21 02:10:20 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:20 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ffb05775-33e4-4e22-b19a-94990a23d0bb" returned: 0 in 0.448s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:20 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-quobyte-ffb05775-33e4-4e22-b19a-94990a23d0bb" released by "delete_volume" :: held 1.002s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:20 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] Created reservations ['1300acbf-31fd-4734-a4bf-0d63cea5a3cd', 'e928d96a-100a-4d21-9a08-f53799e20c9e', '0c8547eb-de88-46e2-9ac8-d18cb213ae76', 'c258e17d-7f99-448b-bf4d-6957230a52da'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:10:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:20 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:10:20 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:10:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:20 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:10:20 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:21 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.417s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:21 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:10:21 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] Deleted volume successfully. Apr 21 02:10:21 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6fa7f9e0-9e06-45fb-ab58-092739faefe0 tempest-VolumeDependencyTests-1425439664 None] Lock "cinder-ffb05775-33e4-4e22-b19a-94990a23d0bb-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:30 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:UPDATE=40,cinder:SELECT=22,cinder:INSERT=9,cinder:DELETE=3 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:10:31 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:UPDATE=36,cinder:SELECT=22,cinder:DELETE=3,cinder:INSERT=9 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Flow 'volume_create_manager' (2e1278f8-1a5f-4999-8402-17cbc038d6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0c7cfb-6211-4213-8795-288857731528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0c7cfb-6211-4213-8795-288857731528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1690514222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6597eb72-d030-4cbb-8d99-92119bb67abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6535c614a3af4e229e0aedca24a0c66c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:10:37Z,use_quota=True,user_id='5e415db5c50e48a98e9ae7c67a592650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c0f350-26b9-4078-bb0f-d7e724466594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c0f350-26b9-4078-bb0f-d7e724466594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba54393c-cb58-48a4-9fa1-a02baa82a54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba54393c-cb58-48a4-9fa1-a02baa82a54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6597eb72-d030-4cbb-8d99-92119bb67abf', 'volume_name': 'volume-6597eb72-d030-4cbb-8d99-92119bb67abf', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd443bbd-4300-4971-8373-74f2047eb192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd443bbd-4300-4971-8373-74f2047eb192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f21dfe73-6dd9-4e52-a422-c65603265754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:36 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Volume 6597eb72-d030-4cbb-8d99-92119bb67abf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6597eb72-d030-4cbb-8d99-92119bb67abf', 'volume_size': 1} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1690514222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6597eb72-d030-4cbb-8d99-92119bb67abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6535c614a3af4e229e0aedca24a0c66c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:10:37Z,use_quota=True,user_id='5e415db5c50e48a98e9ae7c67a592650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Creating volume 6597eb72-d030-4cbb-8d99-92119bb67abf {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:10:36 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:10:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:36 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf 1073741824 Apr 21 02:10:36 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:37 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf 1073741824" returned: 0 in 0.510s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:37 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf Apr 21 02:10:37 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:37 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf" returned: 0 in 0.458s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:10:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f21dfe73-6dd9-4e52-a422-c65603265754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6597eb72-d030-4cbb-8d99-92119bb67abf', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67947d48-898f-4172-9177-119f28147690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:37 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Volume volume-6597eb72-d030-4cbb-8d99-92119bb67abf (6597eb72-d030-4cbb-8d99-92119bb67abf): created successfully Apr 21 02:10:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67947d48-898f-4172-9177-119f28147690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Flow 'volume_create_manager' (2e1278f8-1a5f-4999-8402-17cbc038d6a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:10:37 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-cf68637f-1701-4f8a-9947-ac570054a9a2 tempest-SnapshotDependencyTests-1412277995 None] Created volume successfully. Apr 21 02:10:38 devstack cinder-volume[82184]: DEBUG oslo_service.periodic_task [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 02:10:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:10:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:10:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:38 devstack sudo[89346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:10:38 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] Creating offline snapshot 973b9463-806a-4ab6-8035-aedc526e6e3f of volume 6597eb72-d030-4cbb-8d99-92119bb67abf {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:10:38 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf4ee27-190e-44e0-8ff5-493dd5da0820]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:39 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf Apr 21 02:10:39 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:39 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.495s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:39 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:10:39 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf" returned: 0 in 0.566s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:39 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f 1G Apr 21 02:10:39 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:40 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f 1G" returned: 0 in 0.545s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6597eb72-d030-4cbb-8d99-92119bb67abf -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:40 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6597eb72-d030-4cbb-8d99-92119bb67abf -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f Apr 21 02:10:40 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:40 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6597eb72-d030-4cbb-8d99-92119bb67abf -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f" returned: 0 in 0.466s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:40 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f is being set with open permissions: ugo+rw Apr 21 02:10:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:40 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f Apr 21 02:10:40 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:41 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f" returned: 0 in 0.490s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:41 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.info Apr 21 02:10:41 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:41 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.info" returned: 0 in 0.475s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:41 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.info is being set with open permissions: ugo+rw Apr 21 02:10:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:41 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.info Apr 21 02:10:41 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:41 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.info" returned: 0 in 0.430s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.060s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:42 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-a00e8d80-536d-4373-b871-04180b893825 tempest-SnapshotDependencyTests-1412277995 None] Create snapshot completed successfully Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Flow 'volume_create_manager' (5d17397e-9e91-4804-abbb-7fd4b62b2c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9905814-081d-4512-aa59-574a8a8118f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9905814-081d-4512-aa59-574a8a8118f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ddf5c50-4202-4038-9800-422e90563eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6535c614a3af4e229e0aedca24a0c66c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=973b9463-806a-4ab6-8035-aedc526e6e3f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:10:43Z,use_quota=True,user_id='5e415db5c50e48a98e9ae7c67a592650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d609f4-6a2d-4252-a7db-265e7286f08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d609f4-6a2d-4252-a7db-265e7286f08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445707f3-974c-4c6c-9de3-0cb2c6af4056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445707f3-974c-4c6c-9de3-0cb2c6af4056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6ddf5c50-4202-4038-9800-422e90563eca', 'volume_name': 'volume-6ddf5c50-4202-4038-9800-422e90563eca', 'volume_size': 1, 'snapshot_id': '973b9463-806a-4ab6-8035-aedc526e6e3f'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69845d8c-0b0c-4540-b74a-e385aaadf028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69845d8c-0b0c-4540-b74a-e385aaadf028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7fe1f8-0e81-49ae-ba72-0c9644afb291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:43 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Volume 6ddf5c50-4202-4038-9800-422e90563eca: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6ddf5c50-4202-4038-9800-422e90563eca', 'volume_size': 1, 'snapshot_id': '973b9463-806a-4ab6-8035-aedc526e6e3f'} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Acquiring lock "cinder-quobyte-973b9463-806a-4ab6-8035-aedc526e6e3f-6ddf5c50-4202-4038-9800-422e90563eca" by "_create_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Lock "cinder-quobyte-973b9463-806a-4ab6-8035-aedc526e6e3f-6ddf5c50-4202-4038-9800-422e90563eca" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Creating volume 6ddf5c50-4202-4038-9800-422e90563eca from snapshot 973b9463-806a-4ab6-8035-aedc526e6e3f {{(pid=82184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Acquiring lock "cinder-quobyte-6ddf5c50-4202-4038-9800-422e90563eca" by "_copy_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Lock "cinder-quobyte-6ddf5c50-4202-4038-9800-422e90563eca" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] snapshot: 973b9463-806a-4ab6-8035-aedc526e6e3f, volume: 6ddf5c50-4202-4038-9800-422e90563eca, {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f71873d-56de-421f-9998-57ace90043a5]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:43 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f Apr 21 02:10:43 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:44 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f" returned: 0 in 0.510s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:44 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6597eb72-d030-4cbb-8d99-92119bb67abf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:10:44 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 02:10:44 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Creating direct copy from snapshot {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 02:10:44 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[57991bd5-3d86-4009-8de7-ba4d711f9125]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:44 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf Apr 21 02:10:44 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:44 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf" returned: 0 in 0.485s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:44 devstack cinder-volume[82184]: DEBUG cinder.utils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Path /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ddf5c50-4202-4038-9800-422e90563eca not found in is_blk_device check {{(pid=82184) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 02:10:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ddf5c50-4202-4038-9800-422e90563eca {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:44 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ddf5c50-4202-4038-9800-422e90563eca Apr 21 02:10:44 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:46 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ddf5c50-4202-4038-9800-422e90563eca" returned: 0 in 2.010s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:46 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4db1c6-f396-4de2-bb47-fdf4016a9e19]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:46 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf Apr 21 02:10:46 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:47 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf" returned: 0 in 0.599s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:47 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Image conversion details: src /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf, size 1024.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ddf5c50-4202-4038-9800-422e90563eca {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:10:47 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Converted 1024.00 MB image at 509.09 MB/s Apr 21 02:10:47 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ddf5c50-4202-4038-9800-422e90563eca is being set with open permissions: ugo+rw Apr 21 02:10:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ddf5c50-4202-4038-9800-422e90563eca {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:47 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ddf5c50-4202-4038-9800-422e90563eca Apr 21 02:10:47 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:47 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ddf5c50-4202-4038-9800-422e90563eca" returned: 0 in 0.416s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Lock "cinder-quobyte-6ddf5c50-4202-4038-9800-422e90563eca" released by "_copy_volume_from_snapshot" :: held 4.074s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Lock "cinder-quobyte-973b9463-806a-4ab6-8035-aedc526e6e3f-6ddf5c50-4202-4038-9800-422e90563eca" released by "_create_volume_from_snapshot" :: held 4.090s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.098s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:47 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7fe1f8-0e81-49ae-ba72-0c9644afb291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ddf5c50-4202-4038-9800-422e90563eca', 'volume_size': 1, 'snapshot_id': '973b9463-806a-4ab6-8035-aedc526e6e3f'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:47 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff6af23-2eb5-4339-b8d3-a7b0b8c1a384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:10:47 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Volume volume-6ddf5c50-4202-4038-9800-422e90563eca (6ddf5c50-4202-4038-9800-422e90563eca): created successfully Apr 21 02:10:47 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff6af23-2eb5-4339-b8d3-a7b0b8c1a384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:10:47 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Flow 'volume_create_manager' (5d17397e-9e91-4804-abbb-7fd4b62b2c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:10:47 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-92e2a692-fc92-4eb8-b32d-0b934905edbd tempest-SnapshotDependencyTests-1412277995 None] Created volume successfully. Apr 21 02:10:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] Acquiring lock "cinder-973b9463-806a-4ab6-8035-aedc526e6e3f-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] Lock "cinder-973b9463-806a-4ab6-8035-aedc526e6e3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] Acquiring lock "cinder-quobyte-6597eb72-d030-4cbb-8d99-92119bb67abf" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] Lock "cinder-quobyte-6597eb72-d030-4cbb-8d99-92119bb67abf" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] Acquiring lock "cinder-quobyte-973b9463-806a-4ab6-8035-aedc526e6e3f" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] Lock "cinder-quobyte-973b9463-806a-4ab6-8035-aedc526e6e3f" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] Deleting offline snapshot 973b9463-806a-4ab6-8035-aedc526e6e3f of volume 6597eb72-d030-4cbb-8d99-92119bb67abf {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:10:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] snapshot_file for this snap is: volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:10:48 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0959ca89-37c0-4960-93f5-110f9cf47d9f]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:48 devstack sudo[89414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f Apr 21 02:10:48 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:49 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f" returned: 0 in 0.553s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:49 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6597eb72-d030-4cbb-8d99-92119bb67abf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:10:49 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3264ce9e-ff64-4a92-876b-b077664ff8e1]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:49 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf Apr 21 02:10:49 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:49 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf" returned: 0 in 0.545s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:50 devstack sudo[89441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f Apr 21 02:10:50 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:50 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f" returned: 0 in 0.470s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:50 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f Apr 21 02:10:50 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:50 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf.973b9463-806a-4ab6-8035-aedc526e6e3f" returned: 0 in 0.422s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:50 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] Lock "cinder-quobyte-973b9463-806a-4ab6-8035-aedc526e6e3f" released by "_delete_snapshot" :: held 2.045s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:50 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] Lock "cinder-quobyte-6597eb72-d030-4cbb-8d99-92119bb67abf" released by "delete_snapshot" :: held 2.057s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:50 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] Created reservations ['9391a229-dbfb-4732-bb74-e65a2fff75ca', '6430b984-0568-4baa-955a-9829bd0ac6d5', '8d637a23-ece5-4b8b-8ca3-abaa63175247', 'd47c1330-5e8c-48a6-b43f-68bc9f464af7'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:10:50 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] Delete snapshot completed successfully. Apr 21 02:10:50 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-60b90b2f-0808-43f7-8b5a-9f430b0efb27 tempest-SnapshotDependencyTests-1412277995 None] Lock "cinder-973b9463-806a-4ab6-8035-aedc526e6e3f-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:51 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] Acquiring lock "cinder-6597eb72-d030-4cbb-8d99-92119bb67abf-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:51 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] Lock "cinder-6597eb72-d030-4cbb-8d99-92119bb67abf-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:52 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] Acquiring lock "cinder-quobyte-6597eb72-d030-4cbb-8d99-92119bb67abf" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:52 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] Lock "cinder-quobyte-6597eb72-d030-4cbb-8d99-92119bb67abf" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:52 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9a81eb-c6de-4fd7-817e-1fd1133ec2c6]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:52 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf Apr 21 02:10:52 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:52 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf" returned: 0 in 0.468s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:52 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf Apr 21 02:10:52 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:52 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6597eb72-d030-4cbb-8d99-92119bb67abf" returned: 0 in 0.398s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:52 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] Lock "cinder-quobyte-6597eb72-d030-4cbb-8d99-92119bb67abf" released by "delete_volume" :: held 0.903s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:52 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] Created reservations ['5c52e9bb-210a-4394-8d1f-d428a40fdddc', 'ee6f3b6a-2437-46c7-8456-2a86c436ff17', '54a791ba-d5bb-4cd6-9cd3-2525a1f3d5ae', '643777a2-020d-4e4d-a445-9218c2fc4f0d'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:10:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:52 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:10:53 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:10:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:53 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:10:53 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:53 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] Acquiring lock "cinder-6ddf5c50-4202-4038-9800-422e90563eca-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:53 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] Lock "cinder-6ddf5c50-4202-4038-9800-422e90563eca-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:53 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] Acquiring lock "cinder-quobyte-6ddf5c50-4202-4038-9800-422e90563eca" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:10:53 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] Lock "cinder-quobyte-6ddf5c50-4202-4038-9800-422e90563eca" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:10:53 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[94709984-cad8-40aa-9669-dbb7048e83c9]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:10:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ddf5c50-4202-4038-9800-422e90563eca {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:53 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ddf5c50-4202-4038-9800-422e90563eca Apr 21 02:10:53 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:53 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.468s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:53 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:10:53 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] Deleted volume successfully. Apr 21 02:10:53 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9e85521f-68a0-4748-855f-ea0de55c133e tempest-SnapshotDependencyTests-1412277995 None] Lock "cinder-6597eb72-d030-4cbb-8d99-92119bb67abf-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:53 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ddf5c50-4202-4038-9800-422e90563eca" returned: 0 in 0.478s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ddf5c50-4202-4038-9800-422e90563eca {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:53 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ddf5c50-4202-4038-9800-422e90563eca Apr 21 02:10:53 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:54 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6ddf5c50-4202-4038-9800-422e90563eca" returned: 0 in 0.450s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:54 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] Lock "cinder-quobyte-6ddf5c50-4202-4038-9800-422e90563eca" released by "delete_volume" :: held 0.948s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:10:54 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] Created reservations ['857282f4-a453-48a7-ab17-820b5c9e84ca', 'dacc12d9-8ffb-4d15-8caa-53601432ce11', '3fbdbc22-095f-4ac9-8179-5b4b82e17cab', '25e6f088-b9e4-49e1-b829-c3d6bfaaf909'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:10:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:10:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:10:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:10:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:10:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:10:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:10:54 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:10:54 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:10:54 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Apr 21 02:10:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.505s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:10:54 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:10:54 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] Deleted volume successfully. Apr 21 02:10:54 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-9e2fb43b-7a6a-49ce-a804-f1a1694754ba tempest-SnapshotDependencyTests-1412277995 None] Lock "cinder-6ddf5c50-4202-4038-9800-422e90563eca-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Flow 'volume_create_manager' (7141c2c0-e3b4-4f75-88e1-1ee8f7668e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03662009-0609-4df7-985e-8a95f59d394c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03662009-0609-4df7-985e-8a95f59d394c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1106097975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92ef0b8-8e46-4e60-856d-f755ac7500d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b817a4f11247c1a8fb9e98e8dff4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:01Z,use_quota=True,user_id='ac25c5edc6aa4bfe877ff7c70a0fa601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2da8c2-c1ab-4cad-9cdd-3b8d85762cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2da8c2-c1ab-4cad-9cdd-3b8d85762cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab818cc-7d7f-4fc0-b451-52fff51d48c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab818cc-7d7f-4fc0-b451-52fff51d48c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a92ef0b8-8e46-4e60-856d-f755ac7500d6', 'volume_name': 'volume-a92ef0b8-8e46-4e60-856d-f755ac7500d6', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca3340c-a697-4df8-8bc6-5061fb417beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca3340c-a697-4df8-8bc6-5061fb417beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f3519b-ca33-4c20-b44b-f448d3d6e760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:01 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Volume a92ef0b8-8e46-4e60-856d-f755ac7500d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a92ef0b8-8e46-4e60-856d-f755ac7500d6', 'volume_size': 1} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1106097975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92ef0b8-8e46-4e60-856d-f755ac7500d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b817a4f11247c1a8fb9e98e8dff4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:01Z,use_quota=True,user_id='ac25c5edc6aa4bfe877ff7c70a0fa601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Creating volume a92ef0b8-8e46-4e60-856d-f755ac7500d6 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:11:01 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a92ef0b8-8e46-4e60-856d-f755ac7500d6 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:01 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a92ef0b8-8e46-4e60-856d-f755ac7500d6 1073741824 Apr 21 02:11:01 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:01 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a92ef0b8-8e46-4e60-856d-f755ac7500d6 1073741824" returned: 0 in 0.464s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a92ef0b8-8e46-4e60-856d-f755ac7500d6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:01 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a92ef0b8-8e46-4e60-856d-f755ac7500d6 Apr 21 02:11:01 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:01 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a92ef0b8-8e46-4e60-856d-f755ac7500d6" returned: 0 in 0.395s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f3519b-ca33-4c20-b44b-f448d3d6e760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92ef0b8-8e46-4e60-856d-f755ac7500d6', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afadd4c7-d2cb-459a-bc78-7ddae82e50b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:02 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Volume volume-a92ef0b8-8e46-4e60-856d-f755ac7500d6 (a92ef0b8-8e46-4e60-856d-f755ac7500d6): created successfully Apr 21 02:11:02 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afadd4c7-d2cb-459a-bc78-7ddae82e50b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:02 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Flow 'volume_create_manager' (7141c2c0-e3b4-4f75-88e1-1ee8f7668e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:02 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b483dcfe-dc3d-4c2c-a40d-6813f37d5571 tempest-VolumesActionsTest-1354805026 None] Created volume successfully. Apr 21 02:11:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2509a09b-a7a3-44e0-88c2-1ec588d82797 tempest-VolumesActionsTest-1354805026 None] Acquiring lock "cinder-a92ef0b8-8e46-4e60-856d-f755ac7500d6" by "attach_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2509a09b-a7a3-44e0-88c2-1ec588d82797 tempest-VolumesActionsTest-1354805026 None] Lock "cinder-a92ef0b8-8e46-4e60-856d-f755ac7500d6" acquired by "attach_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:03 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-2509a09b-a7a3-44e0-88c2-1ec588d82797 tempest-VolumesActionsTest-1354805026 None] Attaching volume a92ef0b8-8e46-4e60-856d-f755ac7500d6 to instance 79e78132-2641-450b-9ae4-c0fd99440d9c at mountpoint /dev/vdb on host None. Apr 21 02:11:03 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-2509a09b-a7a3-44e0-88c2-1ec588d82797 tempest-VolumesActionsTest-1354805026 None] Attach volume completed successfully. Apr 21 02:11:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2509a09b-a7a3-44e0-88c2-1ec588d82797 tempest-VolumesActionsTest-1354805026 None] Lock "cinder-a92ef0b8-8e46-4e60-856d-f755ac7500d6" released by "attach_volume" :: held 0.054s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:04 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-72c0b31d-01e7-4eeb-bcf2-e1bdf29a9bf8 tempest-VolumesActionsTest-1626519818 None] Terminate volume connection completed successfully. Apr 21 02:11:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-72c0b31d-01e7-4eeb-bcf2-e1bdf29a9bf8 tempest-VolumesActionsTest-1626519818 None] Acquiring lock "cinder-a92ef0b8-8e46-4e60-856d-f755ac7500d6-detach_volume" by "detach_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-72c0b31d-01e7-4eeb-bcf2-e1bdf29a9bf8 tempest-VolumesActionsTest-1626519818 None] Lock "cinder-a92ef0b8-8e46-4e60-856d-f755ac7500d6-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:04 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-72c0b31d-01e7-4eeb-bcf2-e1bdf29a9bf8 tempest-VolumesActionsTest-1626519818 None] Detaching volume a92ef0b8-8e46-4e60-856d-f755ac7500d6 from instance 79e78132-2641-450b-9ae4-c0fd99440d9c. Apr 21 02:11:04 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-72c0b31d-01e7-4eeb-bcf2-e1bdf29a9bf8 tempest-VolumesActionsTest-1626519818 None] Detach volume completed successfully. Apr 21 02:11:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-72c0b31d-01e7-4eeb-bcf2-e1bdf29a9bf8 tempest-VolumesActionsTest-1626519818 None] Lock "cinder-a92ef0b8-8e46-4e60-856d-f755ac7500d6-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f9c09ee2-74ff-417f-a9b6-5f5a72c461cf tempest-VolumesActionsTest-1354805026 None] Acquiring lock "cinder-a92ef0b8-8e46-4e60-856d-f755ac7500d6-detach_volume" by "detach_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f9c09ee2-74ff-417f-a9b6-5f5a72c461cf tempest-VolumesActionsTest-1354805026 None] Lock "cinder-a92ef0b8-8e46-4e60-856d-f755ac7500d6-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:05 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-f9c09ee2-74ff-417f-a9b6-5f5a72c461cf tempest-VolumesActionsTest-1354805026 None] Volume detach called, but volume not attached. Apr 21 02:11:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f9c09ee2-74ff-417f-a9b6-5f5a72c461cf tempest-VolumesActionsTest-1354805026 None] Lock "cinder-a92ef0b8-8e46-4e60-856d-f755ac7500d6-detach_volume" released by "detach_volume" :: held 0.010s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] Acquiring lock "cinder-a92ef0b8-8e46-4e60-856d-f755ac7500d6-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] Lock "cinder-a92ef0b8-8e46-4e60-856d-f755ac7500d6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] Acquiring lock "cinder-quobyte-a92ef0b8-8e46-4e60-856d-f755ac7500d6" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] Lock "cinder-quobyte-a92ef0b8-8e46-4e60-856d-f755ac7500d6" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:05 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8cc295-52ed-4931-bb1b-617f53656574]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:11:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a92ef0b8-8e46-4e60-856d-f755ac7500d6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:05 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a92ef0b8-8e46-4e60-856d-f755ac7500d6 Apr 21 02:11:05 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:06 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a92ef0b8-8e46-4e60-856d-f755ac7500d6" returned: 0 in 0.447s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a92ef0b8-8e46-4e60-856d-f755ac7500d6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:06 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a92ef0b8-8e46-4e60-856d-f755ac7500d6 Apr 21 02:11:06 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:06 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-a92ef0b8-8e46-4e60-856d-f755ac7500d6" returned: 0 in 0.385s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:06 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] Lock "cinder-quobyte-a92ef0b8-8e46-4e60-856d-f755ac7500d6" released by "delete_volume" :: held 0.864s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:06 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] Created reservations ['1e0601c5-1769-4eb7-97f6-4bfba6580638', 'a058383d-b07f-4b04-9c73-2a8f88b83260', 'e5fa553c-8938-450c-b992-e7956d1b8464', '2f4a9388-e38b-45a1-b4ff-3b47e15192c3'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:11:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:06 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:06 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:11:06 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:07 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.459s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:07 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:11:07 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] Deleted volume successfully. Apr 21 02:11:07 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-31f247e6-2b06-41f9-84f1-54df06138aa4 tempest-VolumesActionsTest-1354805026 None] Lock "cinder-a92ef0b8-8e46-4e60-856d-f755ac7500d6-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Flow 'volume_create_manager' (e019dca7-ea6c-45b2-8d0f-766addc36316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44bba254-a81a-420f-aaf5-a98bcaf5a03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44bba254-a81a-420f-aaf5-a98bcaf5a03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1188421834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832d861e-fba7-4d9b-831c-ed82ac3e679f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b817a4f11247c1a8fb9e98e8dff4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:14Z,use_quota=True,user_id='ac25c5edc6aa4bfe877ff7c70a0fa601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1803ba55-f358-4661-9621-a509b2b39d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1803ba55-f358-4661-9621-a509b2b39d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd60865c-17cc-46b7-a8ed-1f177c2681da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd60865c-17cc-46b7-a8ed-1f177c2681da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '832d861e-fba7-4d9b-831c-ed82ac3e679f', 'volume_name': 'volume-832d861e-fba7-4d9b-831c-ed82ac3e679f', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99b70fc-8d91-4066-bdb4-d708493c0dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99b70fc-8d91-4066-bdb4-d708493c0dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0820a1e-f41f-4a83-86e5-33efbd56d6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:14 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Volume 832d861e-fba7-4d9b-831c-ed82ac3e679f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-832d861e-fba7-4d9b-831c-ed82ac3e679f', 'volume_size': 1} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1188421834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832d861e-fba7-4d9b-831c-ed82ac3e679f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b817a4f11247c1a8fb9e98e8dff4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:14Z,use_quota=True,user_id='ac25c5edc6aa4bfe877ff7c70a0fa601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Creating volume 832d861e-fba7-4d9b-831c-ed82ac3e679f {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:11:14 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-832d861e-fba7-4d9b-831c-ed82ac3e679f 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:14 devstack sudo[89594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-832d861e-fba7-4d9b-831c-ed82ac3e679f 1073741824 Apr 21 02:11:14 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:14 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-832d861e-fba7-4d9b-831c-ed82ac3e679f 1073741824" returned: 0 in 0.462s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-832d861e-fba7-4d9b-831c-ed82ac3e679f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:14 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-832d861e-fba7-4d9b-831c-ed82ac3e679f Apr 21 02:11:14 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:15 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-832d861e-fba7-4d9b-831c-ed82ac3e679f" returned: 0 in 0.434s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:11:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0820a1e-f41f-4a83-86e5-33efbd56d6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-832d861e-fba7-4d9b-831c-ed82ac3e679f', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00eb2068-8929-458c-880e-97b98910f7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:15 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Volume volume-832d861e-fba7-4d9b-831c-ed82ac3e679f (832d861e-fba7-4d9b-831c-ed82ac3e679f): created successfully Apr 21 02:11:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00eb2068-8929-458c-880e-97b98910f7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Flow 'volume_create_manager' (e019dca7-ea6c-45b2-8d0f-766addc36316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:15 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-71617c13-7021-4af0-b7f4-7c49b49505ee tempest-VolumesActionsTest-1354805026 None] Created volume successfully. Apr 21 02:11:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] Acquiring lock "cinder-832d861e-fba7-4d9b-831c-ed82ac3e679f-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] Lock "cinder-832d861e-fba7-4d9b-831c-ed82ac3e679f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] Acquiring lock "cinder-quobyte-832d861e-fba7-4d9b-831c-ed82ac3e679f" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] Lock "cinder-quobyte-832d861e-fba7-4d9b-831c-ed82ac3e679f" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:16 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f08443-fefd-4258-9515-a567393a7848]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:11:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-832d861e-fba7-4d9b-831c-ed82ac3e679f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:16 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-832d861e-fba7-4d9b-831c-ed82ac3e679f Apr 21 02:11:16 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:16 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-832d861e-fba7-4d9b-831c-ed82ac3e679f" returned: 0 in 0.450s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-832d861e-fba7-4d9b-831c-ed82ac3e679f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:16 devstack sudo[89608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-832d861e-fba7-4d9b-831c-ed82ac3e679f Apr 21 02:11:16 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:17 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-832d861e-fba7-4d9b-831c-ed82ac3e679f" returned: 0 in 0.412s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] Lock "cinder-quobyte-832d861e-fba7-4d9b-831c-ed82ac3e679f" released by "delete_volume" :: held 0.890s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] Created reservations ['3e4f3acd-810a-4e19-ab1f-b42b166b4787', 'b2b3afea-88d2-4f49-b8eb-04f4f1d8cb12', '05329ce1-c7b5-4530-9d1d-f8c288ecc8f0', '6f6558af-dda3-4a3c-9028-3f93044e4ce9'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:17 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:11:17 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Flow 'volume_create_manager' (17d79603-2816-4f41-9c26-29c48d68edbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5ae1ab-a1b0-4e25-93f3-0de475cf805c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5ae1ab-a1b0-4e25-93f3-0de475cf805c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-965646474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d719414a-e7f4-4656-8bbf-d12c50010571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b817a4f11247c1a8fb9e98e8dff4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:18Z,use_quota=True,user_id='ac25c5edc6aa4bfe877ff7c70a0fa601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1819625-e7b9-4bd0-80f5-0afc8d89f6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1819625-e7b9-4bd0-80f5-0afc8d89f6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958ae4c8-95ce-4b2c-aa2b-244d134baebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958ae4c8-95ce-4b2c-aa2b-244d134baebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd719414a-e7f4-4656-8bbf-d12c50010571', 'volume_name': 'volume-d719414a-e7f4-4656-8bbf-d12c50010571', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4301071f-c0a8-440e-8d1b-86558da14f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4301071f-c0a8-440e-8d1b-86558da14f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:17 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d875c187-3f8f-4681-853e-4157f4838f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:17 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Volume d719414a-e7f4-4656-8bbf-d12c50010571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d719414a-e7f4-4656-8bbf-d12c50010571', 'volume_size': 1} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-965646474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d719414a-e7f4-4656-8bbf-d12c50010571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b817a4f11247c1a8fb9e98e8dff4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:18Z,use_quota=True,user_id='ac25c5edc6aa4bfe877ff7c70a0fa601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Creating volume d719414a-e7f4-4656-8bbf-d12c50010571 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:11:17 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d719414a-e7f4-4656-8bbf-d12c50010571 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.440s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:11:17 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] Deleted volume successfully. Apr 21 02:11:17 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d719414a-e7f4-4656-8bbf-d12c50010571 1073741824 Apr 21 02:11:17 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c83b78f0-4e46-45ea-b76c-6f87f7b30ae8 tempest-VolumesActionsTest-1626519818 None] Lock "cinder-832d861e-fba7-4d9b-831c-ed82ac3e679f-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:18 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d719414a-e7f4-4656-8bbf-d12c50010571 1073741824" returned: 0 in 0.454s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d719414a-e7f4-4656-8bbf-d12c50010571 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:18 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d719414a-e7f4-4656-8bbf-d12c50010571 Apr 21 02:11:18 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:18 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d719414a-e7f4-4656-8bbf-d12c50010571" returned: 0 in 0.398s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:11:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d875c187-3f8f-4681-853e-4157f4838f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d719414a-e7f4-4656-8bbf-d12c50010571', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802a996e-bfc3-42e8-a762-c7f59772a77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:18 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Volume volume-d719414a-e7f4-4656-8bbf-d12c50010571 (d719414a-e7f4-4656-8bbf-d12c50010571): created successfully Apr 21 02:11:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802a996e-bfc3-42e8-a762-c7f59772a77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:18 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Flow 'volume_create_manager' (17d79603-2816-4f41-9c26-29c48d68edbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:18 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-e8c63280-2e57-4ff7-896b-a02e6426dd2a tempest-VolumesActionsTest-1354805026 None] Created volume successfully. Apr 21 02:11:18 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] Acquiring lock "cinder-d719414a-e7f4-4656-8bbf-d12c50010571-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:18 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] Lock "cinder-d719414a-e7f4-4656-8bbf-d12c50010571-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:18 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] Acquiring lock "cinder-quobyte-d719414a-e7f4-4656-8bbf-d12c50010571" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:18 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] Lock "cinder-quobyte-d719414a-e7f4-4656-8bbf-d12c50010571" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:18 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2775fffd-09df-44fa-9d8c-ade3b3ce02cf]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:11:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d719414a-e7f4-4656-8bbf-d12c50010571 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:19 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d719414a-e7f4-4656-8bbf-d12c50010571 Apr 21 02:11:19 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:19 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d719414a-e7f4-4656-8bbf-d12c50010571" returned: 0 in 0.447s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d719414a-e7f4-4656-8bbf-d12c50010571 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:19 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d719414a-e7f4-4656-8bbf-d12c50010571 Apr 21 02:11:19 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:19 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-d719414a-e7f4-4656-8bbf-d12c50010571" returned: 0 in 0.399s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] Lock "cinder-quobyte-d719414a-e7f4-4656-8bbf-d12c50010571" released by "delete_volume" :: held 0.886s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:19 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] Created reservations ['0caceb56-dcb7-48bc-ae14-bacebba190d1', 'ab7650d5-c9f3-48cf-bfc3-e474e50cb3d8', '87a362b0-0eb8-4c17-8170-c23d29a4a04d', 'bd5a4816-cce1-4086-bcb9-990f13a9b34b'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:11:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:19 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:19 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:19 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:11:19 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Flow 'volume_create_manager' (22c9f634-0633-407b-b1a4-6948695511c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8441dd-2f52-446e-bdae-1f9f4509567a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:20 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.432s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:11:20 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] Deleted volume successfully. Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8441dd-2f52-446e-bdae-1f9f4509567a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1916401588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0207e2d7-551e-4796-aec0-7628887f32b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b817a4f11247c1a8fb9e98e8dff4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:20Z,use_quota=True,user_id='ac25c5edc6aa4bfe877ff7c70a0fa601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7365c8c9-4691-4e22-a109-ba3dce634903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7365c8c9-4691-4e22-a109-ba3dce634903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ea188e-7fab-42a3-8a9e-533ba9f3a245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ea188e-7fab-42a3-8a9e-533ba9f3a245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0207e2d7-551e-4796-aec0-7628887f32b5', 'volume_name': 'volume-0207e2d7-551e-4796-aec0-7628887f32b5', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476339c3-b5e2-497f-97c1-20121c909290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476339c3-b5e2-497f-97c1-20121c909290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2269048c-609c-4f7d-acc4-f30df7cb9611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:20 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Volume 0207e2d7-551e-4796-aec0-7628887f32b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0207e2d7-551e-4796-aec0-7628887f32b5', 'volume_size': 1} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1916401588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0207e2d7-551e-4796-aec0-7628887f32b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b817a4f11247c1a8fb9e98e8dff4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:20Z,use_quota=True,user_id='ac25c5edc6aa4bfe877ff7c70a0fa601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Creating volume 0207e2d7-551e-4796-aec0-7628887f32b5 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:11:20 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0207e2d7-551e-4796-aec0-7628887f32b5 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8060c98d-e8a4-4501-9161-c030a6ec5870 tempest-VolumesActionsTest-1626519818 None] Lock "cinder-d719414a-e7f4-4656-8bbf-d12c50010571-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:20 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0207e2d7-551e-4796-aec0-7628887f32b5 1073741824 Apr 21 02:11:20 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:20 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0207e2d7-551e-4796-aec0-7628887f32b5 1073741824" returned: 0 in 0.468s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0207e2d7-551e-4796-aec0-7628887f32b5 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:20 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0207e2d7-551e-4796-aec0-7628887f32b5 Apr 21 02:11:20 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:21 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0207e2d7-551e-4796-aec0-7628887f32b5" returned: 0 in 0.399s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:21 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:11:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2269048c-609c-4f7d-acc4-f30df7cb9611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0207e2d7-551e-4796-aec0-7628887f32b5', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c2913c-3f7f-4fc0-b3e0-53586410e954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:21 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Volume volume-0207e2d7-551e-4796-aec0-7628887f32b5 (0207e2d7-551e-4796-aec0-7628887f32b5): created successfully Apr 21 02:11:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c2913c-3f7f-4fc0-b3e0-53586410e954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:21 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Flow 'volume_create_manager' (22c9f634-0633-407b-b1a4-6948695511c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:21 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-ced75d34-2bd6-4aaf-ac8e-8ddbd0c928ba tempest-VolumesActionsTest-1354805026 None] Created volume successfully. Apr 21 02:11:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] Acquiring lock "cinder-0207e2d7-551e-4796-aec0-7628887f32b5-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] Lock "cinder-0207e2d7-551e-4796-aec0-7628887f32b5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] Acquiring lock "cinder-quobyte-0207e2d7-551e-4796-aec0-7628887f32b5" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] Lock "cinder-quobyte-0207e2d7-551e-4796-aec0-7628887f32b5" acquired by "delete_volume" :: waited 0.014s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:22 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03cecb9-085e-4f0c-849c-71d34807961b]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:11:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0207e2d7-551e-4796-aec0-7628887f32b5 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:22 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0207e2d7-551e-4796-aec0-7628887f32b5 Apr 21 02:11:22 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:23 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0207e2d7-551e-4796-aec0-7628887f32b5" returned: 0 in 0.458s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0207e2d7-551e-4796-aec0-7628887f32b5 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:23 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0207e2d7-551e-4796-aec0-7628887f32b5 Apr 21 02:11:23 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:23 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0207e2d7-551e-4796-aec0-7628887f32b5" returned: 0 in 0.388s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] Lock "cinder-quobyte-0207e2d7-551e-4796-aec0-7628887f32b5" released by "delete_volume" :: held 0.866s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] Created reservations ['93c7c9ac-e16b-4fbb-8860-a79e44836988', '7586fbf4-788b-4cc4-8df7-601a28bf1181', 'c59084d8-d251-4c65-a934-5c69602a7c4c', 'cb3c69f5-5bdb-48bc-b694-b3863794d0bc'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:23 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:11:23 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Flow 'volume_create_manager' (5817329e-8985-48c6-afc2-5a602eaae369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a28c34-1bdd-4f6d-ac76-1a7ee2524797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a28c34-1bdd-4f6d-ac76-1a7ee2524797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1440868891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd9c667-abdf-4054-b6f7-7d1e0a883d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b817a4f11247c1a8fb9e98e8dff4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:24Z,use_quota=True,user_id='ac25c5edc6aa4bfe877ff7c70a0fa601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c2e91e-d572-4d04-b5e2-9833028517aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c2e91e-d572-4d04-b5e2-9833028517aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fc6424-6087-4d9b-bd3d-1efabe263f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fc6424-6087-4d9b-bd3d-1efabe263f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecd9c667-abdf-4054-b6f7-7d1e0a883d19', 'volume_name': 'volume-ecd9c667-abdf-4054-b6f7-7d1e0a883d19', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc7742a-71f7-4870-b89e-2bcd8bc2a07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc7742a-71f7-4870-b89e-2bcd8bc2a07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c2e94f-20ab-46dc-a1c8-f1d9baa747b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:23 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Volume ecd9c667-abdf-4054-b6f7-7d1e0a883d19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecd9c667-abdf-4054-b6f7-7d1e0a883d19', 'volume_size': 1} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1440868891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd9c667-abdf-4054-b6f7-7d1e0a883d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b817a4f11247c1a8fb9e98e8dff4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:24Z,use_quota=True,user_id='ac25c5edc6aa4bfe877ff7c70a0fa601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Creating volume ecd9c667-abdf-4054-b6f7-7d1e0a883d19 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:11:23 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:11:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ecd9c667-abdf-4054-b6f7-7d1e0a883d19 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:23 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ecd9c667-abdf-4054-b6f7-7d1e0a883d19 1073741824 Apr 21 02:11:23 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:24 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.481s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:24 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:11:24 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] Deleted volume successfully. Apr 21 02:11:24 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-06560543-9cf2-49d1-a371-ba2cba8baef4 tempest-VolumesActionsTest-1626519818 None] Lock "cinder-0207e2d7-551e-4796-aec0-7628887f32b5-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:24 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ecd9c667-abdf-4054-b6f7-7d1e0a883d19 1073741824" returned: 0 in 0.471s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ecd9c667-abdf-4054-b6f7-7d1e0a883d19 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:24 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ecd9c667-abdf-4054-b6f7-7d1e0a883d19 Apr 21 02:11:24 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:24 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ecd9c667-abdf-4054-b6f7-7d1e0a883d19" returned: 0 in 0.398s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:11:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c2e94f-20ab-46dc-a1c8-f1d9baa747b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecd9c667-abdf-4054-b6f7-7d1e0a883d19', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00b5c71-f80e-47f1-8d9d-0408af3345e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:24 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Volume volume-ecd9c667-abdf-4054-b6f7-7d1e0a883d19 (ecd9c667-abdf-4054-b6f7-7d1e0a883d19): created successfully Apr 21 02:11:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00b5c71-f80e-47f1-8d9d-0408af3345e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:24 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Flow 'volume_create_manager' (5817329e-8985-48c6-afc2-5a602eaae369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:24 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-48e096aa-bc4e-4fa0-a16e-f0c2504b1979 tempest-VolumesActionsTest-1354805026 None] Created volume successfully. Apr 21 02:11:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] Acquiring lock "cinder-ecd9c667-abdf-4054-b6f7-7d1e0a883d19-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] Lock "cinder-ecd9c667-abdf-4054-b6f7-7d1e0a883d19-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] Acquiring lock "cinder-quobyte-ecd9c667-abdf-4054-b6f7-7d1e0a883d19" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] Lock "cinder-quobyte-ecd9c667-abdf-4054-b6f7-7d1e0a883d19" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:25 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90fdf43-9f6a-4dd7-8512-948471ff1ac4]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:11:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ecd9c667-abdf-4054-b6f7-7d1e0a883d19 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:25 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ecd9c667-abdf-4054-b6f7-7d1e0a883d19 Apr 21 02:11:25 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:25 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ecd9c667-abdf-4054-b6f7-7d1e0a883d19" returned: 0 in 0.444s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ecd9c667-abdf-4054-b6f7-7d1e0a883d19 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:25 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ecd9c667-abdf-4054-b6f7-7d1e0a883d19 Apr 21 02:11:25 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:25 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-ecd9c667-abdf-4054-b6f7-7d1e0a883d19" returned: 0 in 0.394s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] Lock "cinder-quobyte-ecd9c667-abdf-4054-b6f7-7d1e0a883d19" released by "delete_volume" :: held 0.860s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] Created reservations ['aaa3ca07-ed75-418f-b4b1-b01f48be2ec5', 'd57fbfc4-1d0c-4e34-92b6-f96198757990', 'a098881e-4c5b-4c3b-9f07-4e98814a0ad3', '49313829-ee1f-4265-82e2-ab97a2e1a668'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:26 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:11:26 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Flow 'volume_create_manager' (8a4da75c-37b1-4dce-abfc-96478147ac80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97d7a5f-97ae-4cad-8d05-fbeb43e36aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97d7a5f-97ae-4cad-8d05-fbeb43e36aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-483286578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e44b7e-4ed4-47c6-9c3f-5c71ffa15248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b817a4f11247c1a8fb9e98e8dff4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:26Z,use_quota=True,user_id='ac25c5edc6aa4bfe877ff7c70a0fa601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b1d577-b41f-493a-a40b-e07bac6cc30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b1d577-b41f-493a-a40b-e07bac6cc30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b87c021-e576-4c03-80f1-b5a70a81b72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b87c021-e576-4c03-80f1-b5a70a81b72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86e44b7e-4ed4-47c6-9c3f-5c71ffa15248', 'volume_name': 'volume-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb00200-cb44-4791-939b-952ecfa82030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb00200-cb44-4791-939b-952ecfa82030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0b1dd6-5093-42c9-b2df-2b287ddf63f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:26 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Volume 86e44b7e-4ed4-47c6-9c3f-5c71ffa15248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248', 'volume_size': 1} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-483286578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e44b7e-4ed4-47c6-9c3f-5c71ffa15248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b817a4f11247c1a8fb9e98e8dff4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:26Z,use_quota=True,user_id='ac25c5edc6aa4bfe877ff7c70a0fa601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Creating volume 86e44b7e-4ed4-47c6-9c3f-5c71ffa15248 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:11:26 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:26 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.454s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:11:26 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] Deleted volume successfully. Apr 21 02:11:26 devstack sudo[89673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248 1073741824 Apr 21 02:11:26 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6bed201d-f43d-4ff8-8808-0315ebbb8249 tempest-VolumesActionsTest-1626519818 None] Lock "cinder-ecd9c667-abdf-4054-b6f7-7d1e0a883d19-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:26 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248 1073741824" returned: 0 in 0.451s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:26 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248 Apr 21 02:11:26 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:27 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248" returned: 0 in 0.393s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:11:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:27 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0b1dd6-5093-42c9-b2df-2b287ddf63f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:27 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f2db8c2-6a9d-4be2-85e6-c59b4c97a8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:27 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Volume volume-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248 (86e44b7e-4ed4-47c6-9c3f-5c71ffa15248): created successfully Apr 21 02:11:27 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f2db8c2-6a9d-4be2-85e6-c59b4c97a8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:27 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Flow 'volume_create_manager' (8a4da75c-37b1-4dce-abfc-96478147ac80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:27 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-047aa8a7-0b5f-4232-86b2-630e0fcd7f5d tempest-VolumesActionsTest-1354805026 None] Created volume successfully. Apr 21 02:11:27 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] Acquiring lock "cinder-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:27 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] Lock "cinder-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:27 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] Acquiring lock "cinder-quobyte-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:27 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] Lock "cinder-quobyte-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:27 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf9a4d9-621f-4f2c-aab1-19693c4a7b92]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:11:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:28 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248 Apr 21 02:11:28 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:28 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248" returned: 0 in 0.451s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:28 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248 Apr 21 02:11:28 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:28 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248" returned: 0 in 0.391s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:28 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] Lock "cinder-quobyte-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248" released by "delete_volume" :: held 0.861s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:28 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] Created reservations ['f04a7229-6cf9-4f5b-89e1-c752c7dd2563', 'c0a5bd2b-df6e-4dc2-a66f-f520db28ae9a', 'a36420ce-cc92-455c-af83-fc9fb6109960', 'ee63d783-5f0d-4887-983a-45d193e139fd'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:11:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:28 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:28 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:28 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:11:28 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:29 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.421s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:29 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:11:29 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] Deleted volume successfully. Apr 21 02:11:29 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-bbc16ff5-9d07-4824-9d5b-cd66360ab0de tempest-VolumesActionsTest-1354805026 None] Lock "cinder-86e44b7e-4ed4-47c6-9c3f-5c71ffa15248-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:SELECT=71,cinder:UPDATE=95,cinder:DELETE=11,cinder:INSERT=23 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:UPDATE=101,cinder:SELECT=76,cinder:INSERT=23,cinder:DELETE=6 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Flow 'volume_create_manager' (04b74ba5-d1b9-438b-a368-344a02c6e562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6a8857-0a47-4c25-b15a-6669bac74394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6a8857-0a47-4c25-b15a-6669bac74394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1357342424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a5b343-2192-4c52-bfcc-4b1c123fbff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752238c2b6394df8bb074d6e9b0339e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:37Z,use_quota=True,user_id='744446d86ec342fba83a116e513ccc1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f25775e-4453-4aae-967a-ff05f7b9b4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f25775e-4453-4aae-967a-ff05f7b9b4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2a4667-80f2-48cc-b75b-cb4921c1d3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2a4667-80f2-48cc-b75b-cb4921c1d3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a5b343-2192-4c52-bfcc-4b1c123fbff8', 'volume_name': 'volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999a970e-ec9c-49a1-94f2-58f398e6cb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999a970e-ec9c-49a1-94f2-58f398e6cb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f25d380-3f19-4f59-a530-11a0eed6ae39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:36 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Volume e3a5b343-2192-4c52-bfcc-4b1c123fbff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8', 'volume_size': 1} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1357342424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a5b343-2192-4c52-bfcc-4b1c123fbff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752238c2b6394df8bb074d6e9b0339e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:37Z,use_quota=True,user_id='744446d86ec342fba83a116e513ccc1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Creating volume e3a5b343-2192-4c52-bfcc-4b1c123fbff8 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:11:36 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:11:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:36 devstack sudo[89698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8 1073741824 Apr 21 02:11:36 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:37 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8 1073741824" returned: 0 in 0.467s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:37 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8 Apr 21 02:11:37 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:37 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8" returned: 0 in 0.393s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:11:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f25d380-3f19-4f59-a530-11a0eed6ae39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb94ef5-ac76-41e9-b6cd-b6f6f4eacecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:37 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Volume volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8 (e3a5b343-2192-4c52-bfcc-4b1c123fbff8): created successfully Apr 21 02:11:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb94ef5-ac76-41e9-b6cd-b6f6f4eacecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Flow 'volume_create_manager' (04b74ba5-d1b9-438b-a368-344a02c6e562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:37 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-9ed6f746-f3a4-4987-8399-379e2c09dc2d tempest-SnapshotMetadataTestJSON-1585824178 None] Created volume successfully. Apr 21 02:11:38 devstack cinder-volume[82184]: DEBUG oslo_service.periodic_task [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 02:11:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:38 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:11:38 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] Creating offline snapshot ee6ac6e2-00cb-4e6b-acae-46883d64c3af of volume e3a5b343-2192-4c52-bfcc-4b1c123fbff8 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:11:39 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06745db3-d186-479a-8e80-cbcd71042f8d]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:11:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:39 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8 Apr 21 02:11:39 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:39 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.425s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:39 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:11:39 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8" returned: 0 in 0.452s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:39 devstack sudo[89714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af 1G Apr 21 02:11:39 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:40 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af 1G" returned: 0 in 0.463s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:40 devstack sudo[89719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af Apr 21 02:11:40 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:40 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af" returned: 0 in 0.406s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:40 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af is being set with open permissions: ugo+rw Apr 21 02:11:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:40 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af Apr 21 02:11:40 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:40 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af" returned: 0 in 0.390s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:40 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.info Apr 21 02:11:40 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:41 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.info" returned: 0 in 0.398s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:41 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.info is being set with open permissions: ugo+rw Apr 21 02:11:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:41 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.info Apr 21 02:11:41 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:41 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.info" returned: 0 in 0.386s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.549s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:41 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-f6344df9-0d2a-4ee6-b023-ebc5232c98e5 tempest-SnapshotMetadataTestJSON-1585824178 None] Create snapshot completed successfully Apr 21 02:11:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] Acquiring lock "cinder-ee6ac6e2-00cb-4e6b-acae-46883d64c3af-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] Lock "cinder-ee6ac6e2-00cb-4e6b-acae-46883d64c3af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] Acquiring lock "cinder-quobyte-e3a5b343-2192-4c52-bfcc-4b1c123fbff8" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] Lock "cinder-quobyte-e3a5b343-2192-4c52-bfcc-4b1c123fbff8" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] Acquiring lock "cinder-quobyte-ee6ac6e2-00cb-4e6b-acae-46883d64c3af" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] Lock "cinder-quobyte-ee6ac6e2-00cb-4e6b-acae-46883d64c3af" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] Deleting offline snapshot ee6ac6e2-00cb-4e6b-acae-46883d64c3af of volume e3a5b343-2192-4c52-bfcc-4b1c123fbff8 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:11:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] snapshot_file for this snap is: volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:11:42 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f2bee7-20fb-4696-86c1-58291c7c6e29]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:11:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:42 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af Apr 21 02:11:42 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:43 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af" returned: 0 in 0.451s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:11:43 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a53fbb1-ef52-4da9-9f1d-68aa7575b3b5]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:11:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:43 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8 Apr 21 02:11:43 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:43 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8" returned: 0 in 0.455s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:43 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af Apr 21 02:11:43 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:44 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af" returned: 0 in 0.440s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:44 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af Apr 21 02:11:44 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:44 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8.ee6ac6e2-00cb-4e6b-acae-46883d64c3af" returned: 0 in 0.406s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] Lock "cinder-quobyte-ee6ac6e2-00cb-4e6b-acae-46883d64c3af" released by "_delete_snapshot" :: held 1.800s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] Lock "cinder-quobyte-e3a5b343-2192-4c52-bfcc-4b1c123fbff8" released by "delete_snapshot" :: held 1.814s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:44 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] Created reservations ['530b1584-5e3b-4967-ac20-f7c8fe295ce7', '165d7362-7481-456e-997b-22e75eff9146', 'f21ae014-fe38-466e-ad74-c821ac7eafd8', '0d0c9c1a-d286-476d-9365-44e3ee5618ab'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:11:44 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] Delete snapshot completed successfully. Apr 21 02:11:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-570e0e10-14a7-4159-95a7-32019d83677b tempest-SnapshotMetadataTestJSON-1585824178 None] Lock "cinder-ee6ac6e2-00cb-4e6b-acae-46883d64c3af-delete_snapshot" released by "delete_snapshot" :: held 1.885s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] Acquiring lock "cinder-e3a5b343-2192-4c52-bfcc-4b1c123fbff8-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] Lock "cinder-e3a5b343-2192-4c52-bfcc-4b1c123fbff8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] Acquiring lock "cinder-quobyte-e3a5b343-2192-4c52-bfcc-4b1c123fbff8" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] Lock "cinder-quobyte-e3a5b343-2192-4c52-bfcc-4b1c123fbff8" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:44 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d040c3-6dc3-43e9-aefd-5f68286d221c]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:11:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:44 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8 Apr 21 02:11:44 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:45 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8" returned: 0 in 0.454s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:45 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8 Apr 21 02:11:45 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:45 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-e3a5b343-2192-4c52-bfcc-4b1c123fbff8" returned: 0 in 0.398s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:45 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] Lock "cinder-quobyte-e3a5b343-2192-4c52-bfcc-4b1c123fbff8" released by "delete_volume" :: held 0.886s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:45 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] Created reservations ['2f056213-8fa4-4f81-9322-778f99fafb36', '3245415d-95d1-4feb-8fcd-edf15738073a', 'cea47458-e865-42d8-9df6-3890bbec824f', '1b8b28b2-1f11-4891-a9a5-9853b89483bb'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:11:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:45 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:45 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:45 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:11:45 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:46 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.445s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:46 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:11:46 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] Deleted volume successfully. Apr 21 02:11:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-97314abd-eed6-4cf7-a4ee-ab1854d36fbf tempest-SnapshotMetadataTestJSON-1585824178 None] Lock "cinder-e3a5b343-2192-4c52-bfcc-4b1c123fbff8-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Flow 'volume_create_manager' (0df8155d-a566-4217-9086-47d02a831918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e093fa-ebb0-4f16-ad3d-02b30a53248f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e093fa-ebb0-4f16-ad3d-02b30a53248f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-951718225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650eb341f2cf42af8c9ed19baba103ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:48Z,use_quota=True,user_id='401684e5e6b24ebabee745b85c02746a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5f4872-ab84-48e6-a4e5-f79508b23c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5f4872-ab84-48e6-a4e5-f79508b23c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cebd7ef2-f1b6-4592-84a8-61bb9e3ec5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cebd7ef2-f1b6-4592-84a8-61bb9e3ec5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2', 'volume_name': 'volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858d4a3b-4ab7-4469-b5ea-eb0fc8f88ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858d4a3b-4ab7-4469-b5ea-eb0fc8f88ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cecb42a0-da34-406f-b51e-df14cf70f059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:47 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Volume c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2', 'volume_size': 1} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-951718225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650eb341f2cf42af8c9ed19baba103ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:48Z,use_quota=True,user_id='401684e5e6b24ebabee745b85c02746a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Creating volume c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:11:47 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:11:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:47 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 1073741824 Apr 21 02:11:47 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:48 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 1073741824" returned: 0 in 0.447s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:48 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 Apr 21 02:11:48 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:48 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2" returned: 0 in 0.391s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:11:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cecb42a0-da34-406f-b51e-df14cf70f059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea7a143-0d0b-42b9-b734-9d08950ebdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:48 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Volume volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 (c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2): created successfully Apr 21 02:11:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea7a143-0d0b-42b9-b734-9d08950ebdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Flow 'volume_create_manager' (0df8155d-a566-4217-9086-47d02a831918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:48 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-1060963c-4dff-4879-9dd4-57013a6a4d55 tempest-CreateVolumesFromSnapshotTest-164306734 None] Created volume successfully. Apr 21 02:11:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] Creating offline snapshot fe45bd89-60bc-4e23-b6e5-e412772089c2 of volume c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:11:48 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e98a8ef-723d-40e1-ad19-74adb7622838]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:11:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:48 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 Apr 21 02:11:48 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:49 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2" returned: 0 in 0.457s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:49 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2 1G Apr 21 02:11:49 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:49 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2 1G" returned: 0 in 0.448s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:49 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2 Apr 21 02:11:49 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:50 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2" returned: 0 in 0.404s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:50 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2 is being set with open permissions: ugo+rw Apr 21 02:11:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:50 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2 Apr 21 02:11:50 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:50 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2" returned: 0 in 0.393s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:50 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.info Apr 21 02:11:50 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:50 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.info" returned: 0 in 0.395s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:50 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.info is being set with open permissions: ugo+rw Apr 21 02:11:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:50 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.info Apr 21 02:11:50 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:51 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.info" returned: 0 in 0.389s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.537s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:51 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-f3c53d97-999b-4411-b65c-76d13884261b tempest-CreateVolumesFromSnapshotTest-164306734 None] Create snapshot completed successfully Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Flow 'volume_create_manager' (96055098-522e-4702-994d-f70ecae1e483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01e51d2-44f7-4451-9310-a10c68a06a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01e51d2-44f7-4451-9310-a10c68a06a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-247368211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96c7570-535a-48d3-8b22-fc950abe3ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650eb341f2cf42af8c9ed19baba103ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:52Z,use_quota=True,user_id='401684e5e6b24ebabee745b85c02746a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbd3a04-a603-4a2f-b207-410412c16ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbd3a04-a603-4a2f-b207-410412c16ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff63d6c1-a569-4795-a305-0e1fe3081f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff63d6c1-a569-4795-a305-0e1fe3081f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f96c7570-535a-48d3-8b22-fc950abe3ee1', 'volume_name': 'volume-f96c7570-535a-48d3-8b22-fc950abe3ee1', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3202c1e-6d78-48ee-9c22-72a09329f550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3202c1e-6d78-48ee-9c22-72a09329f550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c46de3f-01d9-4e23-aa8f-1a86d9099533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Volume f96c7570-535a-48d3-8b22-fc950abe3ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f96c7570-535a-48d3-8b22-fc950abe3ee1', 'volume_size': 1} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-247368211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96c7570-535a-48d3-8b22-fc950abe3ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650eb341f2cf42af8c9ed19baba103ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:52Z,use_quota=True,user_id='401684e5e6b24ebabee745b85c02746a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Creating volume f96c7570-535a-48d3-8b22-fc950abe3ee1 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:11:52 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f96c7570-535a-48d3-8b22-fc950abe3ee1 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:52 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f96c7570-535a-48d3-8b22-fc950abe3ee1 1073741824 Apr 21 02:11:52 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Flow 'volume_create_manager' (342a280b-e4de-4777-ac5b-888dcbdd9d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62922aa1-21f7-49ea-a825-c48cdc9e35c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62922aa1-21f7-49ea-a825-c48cdc9e35c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1596618644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30bebd9a-5f7c-4f38-93dc-be8596f29a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650eb341f2cf42af8c9ed19baba103ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:52Z,use_quota=True,user_id='401684e5e6b24ebabee745b85c02746a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7563e6a4-c56d-43ee-a7f1-a97f2c19adb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7563e6a4-c56d-43ee-a7f1-a97f2c19adb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2032ac31-5bf7-4faa-9c98-361d87b7d5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2032ac31-5bf7-4faa-9c98-361d87b7d5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30bebd9a-5f7c-4f38-93dc-be8596f29a58', 'volume_name': 'volume-30bebd9a-5f7c-4f38-93dc-be8596f29a58', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4dfa58-60aa-44e7-92b7-afd56b721661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4dfa58-60aa-44e7-92b7-afd56b721661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b137fae-5a1b-4625-9d8f-7f75f7fbedcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Volume 30bebd9a-5f7c-4f38-93dc-be8596f29a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30bebd9a-5f7c-4f38-93dc-be8596f29a58', 'volume_size': 1} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Flow 'volume_create_manager' (43036be7-314f-42b0-abf7-f821d9a9ace9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8dfd5bd-4cae-45c8-ac0a-994fa9959b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8dfd5bd-4cae-45c8-ac0a-994fa9959b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-237314782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5179bd25-8fdd-420d-8643-5400665aaa34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650eb341f2cf42af8c9ed19baba103ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:52Z,use_quota=True,user_id='401684e5e6b24ebabee745b85c02746a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d421dd63-92f3-4a79-8422-beca9d836361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d421dd63-92f3-4a79-8422-beca9d836361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add28001-8ce2-4541-9a90-d6566b9bcabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add28001-8ce2-4541-9a90-d6566b9bcabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5179bd25-8fdd-420d-8643-5400665aaa34', 'volume_name': 'volume-5179bd25-8fdd-420d-8643-5400665aaa34', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa0f874-0950-47ab-8453-4ae8b194b682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa0f874-0950-47ab-8453-4ae8b194b682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d1756d-9944-4527-83aa-70f4d7fe50ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Volume 5179bd25-8fdd-420d-8643-5400665aaa34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5179bd25-8fdd-420d-8643-5400665aaa34', 'volume_size': 1} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Flow 'volume_create_manager' (9e3240eb-eefd-499f-a17a-550b03041d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c0d776-c795-40e1-b1a6-6dd23bb3190b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c0d776-c795-40e1-b1a6-6dd23bb3190b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1825883231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f3a72d-35ac-4af7-b0d2-da17dce3eae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650eb341f2cf42af8c9ed19baba103ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:53Z,use_quota=True,user_id='401684e5e6b24ebabee745b85c02746a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f620eae3-c547-4798-b84c-f52a1568fe22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f620eae3-c547-4798-b84c-f52a1568fe22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab211afc-f3ff-4d78-a6ce-3cb530b30c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab211afc-f3ff-4d78-a6ce-3cb530b30c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87f3a72d-35ac-4af7-b0d2-da17dce3eae1', 'volume_name': 'volume-87f3a72d-35ac-4af7-b0d2-da17dce3eae1', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b399dfbc-6b4d-4e42-b1c2-352956345ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b399dfbc-6b4d-4e42-b1c2-352956345ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52cd45e-6aa9-4b16-b1ce-562103732fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Volume 87f3a72d-35ac-4af7-b0d2-da17dce3eae1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87f3a72d-35ac-4af7-b0d2-da17dce3eae1', 'volume_size': 1} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:52 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f96c7570-535a-48d3-8b22-fc950abe3ee1 1073741824" returned: 0 in 0.592s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f96c7570-535a-48d3-8b22-fc950abe3ee1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:52 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f96c7570-535a-48d3-8b22-fc950abe3ee1 Apr 21 02:11:52 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Flow 'volume_create_manager' (81fbe34c-aa05-431a-b99b-bccd14837090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b596fa-fbdd-4ea8-9f73-92ed58cc49f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b596fa-fbdd-4ea8-9f73-92ed58cc49f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1284175313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8f5c41-f1c3-48e3-9d02-6b491db59379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650eb341f2cf42af8c9ed19baba103ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:53Z,use_quota=True,user_id='401684e5e6b24ebabee745b85c02746a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a19108-4809-4ad7-9280-17483dadc1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a19108-4809-4ad7-9280-17483dadc1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a362b739-87ef-4642-a184-62e8509610e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a362b739-87ef-4642-a184-62e8509610e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c8f5c41-f1c3-48e3-9d02-6b491db59379', 'volume_name': 'volume-4c8f5c41-f1c3-48e3-9d02-6b491db59379', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd1651a-2d40-4ff2-9626-d5128ac314d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd1651a-2d40-4ff2-9626-d5128ac314d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5ae3d1-e38e-4352-9eba-a9ad52516060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:52 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Volume 4c8f5c41-f1c3-48e3-9d02-6b491db59379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c8f5c41-f1c3-48e3-9d02-6b491db59379', 'volume_size': 1} Apr 21 02:11:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:53 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f96c7570-535a-48d3-8b22-fc950abe3ee1" returned: 0 in 0.407s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.831s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1596618644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30bebd9a-5f7c-4f38-93dc-be8596f29a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650eb341f2cf42af8c9ed19baba103ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:52Z,use_quota=True,user_id='401684e5e6b24ebabee745b85c02746a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Creating volume 30bebd9a-5f7c-4f38-93dc-be8596f29a58 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:11:53 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-30bebd9a-5f7c-4f38-93dc-be8596f29a58 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c46de3f-01d9-4e23-aa8f-1a86d9099533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f96c7570-535a-48d3-8b22-fc950abe3ee1', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:53 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-30bebd9a-5f7c-4f38-93dc-be8596f29a58 1073741824 Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0a3a23-8616-4189-a181-7c1986dd7598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:53 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:53 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Volume volume-f96c7570-535a-48d3-8b22-fc950abe3ee1 (f96c7570-535a-48d3-8b22-fc950abe3ee1): created successfully Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0a3a23-8616-4189-a181-7c1986dd7598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Flow 'volume_create_manager' (96055098-522e-4702-994d-f70ecae1e483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:53 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-7401ec90-5847-4868-90bd-6da876b78f3c tempest-CreateVolumesFromSnapshotTest-164306734 None] Created volume successfully. Apr 21 02:11:53 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-30bebd9a-5f7c-4f38-93dc-be8596f29a58 1073741824" returned: 0 in 0.461s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-30bebd9a-5f7c-4f38-93dc-be8596f29a58 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:53 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-30bebd9a-5f7c-4f38-93dc-be8596f29a58 Apr 21 02:11:53 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:54 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-30bebd9a-5f7c-4f38-93dc-be8596f29a58" returned: 0 in 0.397s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.516s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-237314782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5179bd25-8fdd-420d-8643-5400665aaa34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650eb341f2cf42af8c9ed19baba103ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:52Z,use_quota=True,user_id='401684e5e6b24ebabee745b85c02746a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Creating volume 5179bd25-8fdd-420d-8643-5400665aaa34 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:11:54 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5179bd25-8fdd-420d-8643-5400665aaa34 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b137fae-5a1b-4625-9d8f-7f75f7fbedcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30bebd9a-5f7c-4f38-93dc-be8596f29a58', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3975f27a-ce2e-4c69-87b4-592c8cfb78c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:54 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5179bd25-8fdd-420d-8643-5400665aaa34 1073741824 Apr 21 02:11:54 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:54 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Volume volume-30bebd9a-5f7c-4f38-93dc-be8596f29a58 (30bebd9a-5f7c-4f38-93dc-be8596f29a58): created successfully Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3975f27a-ce2e-4c69-87b4-592c8cfb78c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Flow 'volume_create_manager' (342a280b-e4de-4777-ac5b-888dcbdd9d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:54 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-64a9755a-48dc-4c35-8a09-3a9f419bbddf tempest-CreateVolumesFromSnapshotTest-164306734 None] Created volume successfully. Apr 21 02:11:54 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5179bd25-8fdd-420d-8643-5400665aaa34 1073741824" returned: 0 in 0.467s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5179bd25-8fdd-420d-8643-5400665aaa34 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:54 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5179bd25-8fdd-420d-8643-5400665aaa34 Apr 21 02:11:54 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:54 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5179bd25-8fdd-420d-8643-5400665aaa34" returned: 0 in 0.400s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.244s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1825883231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f3a72d-35ac-4af7-b0d2-da17dce3eae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650eb341f2cf42af8c9ed19baba103ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:53Z,use_quota=True,user_id='401684e5e6b24ebabee745b85c02746a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Creating volume 87f3a72d-35ac-4af7-b0d2-da17dce3eae1 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:11:54 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:11:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87f3a72d-35ac-4af7-b0d2-da17dce3eae1 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d1756d-9944-4527-83aa-70f4d7fe50ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5179bd25-8fdd-420d-8643-5400665aaa34', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:55 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87f3a72d-35ac-4af7-b0d2-da17dce3eae1 1073741824 Apr 21 02:11:55 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8afb9286-5fad-4d2b-8d80-40be929d1bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:55 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Volume volume-5179bd25-8fdd-420d-8643-5400665aaa34 (5179bd25-8fdd-420d-8643-5400665aaa34): created successfully Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8afb9286-5fad-4d2b-8d80-40be929d1bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Flow 'volume_create_manager' (43036be7-314f-42b0-abf7-f821d9a9ace9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:55 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-6da4518d-20ab-4e57-b3c8-71dd5c31d19d tempest-CreateVolumesFromSnapshotTest-164306734 None] Created volume successfully. Apr 21 02:11:55 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87f3a72d-35ac-4af7-b0d2-da17dce3eae1 1073741824" returned: 0 in 0.486s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87f3a72d-35ac-4af7-b0d2-da17dce3eae1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:55 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87f3a72d-35ac-4af7-b0d2-da17dce3eae1 Apr 21 02:11:55 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:55 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87f3a72d-35ac-4af7-b0d2-da17dce3eae1" returned: 0 in 0.385s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.985s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1284175313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8f5c41-f1c3-48e3-9d02-6b491db59379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650eb341f2cf42af8c9ed19baba103ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:11:53Z,use_quota=True,user_id='401684e5e6b24ebabee745b85c02746a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Creating volume 4c8f5c41-f1c3-48e3-9d02-6b491db59379 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:11:55 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4c8f5c41-f1c3-48e3-9d02-6b491db59379 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52cd45e-6aa9-4b16-b1ce-562103732fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f3a72d-35ac-4af7-b0d2-da17dce3eae1', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:55 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4c8f5c41-f1c3-48e3-9d02-6b491db59379 1073741824 Apr 21 02:11:55 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1997ec-511d-4995-9976-e9e248a1ef92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:55 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Volume volume-87f3a72d-35ac-4af7-b0d2-da17dce3eae1 (87f3a72d-35ac-4af7-b0d2-da17dce3eae1): created successfully Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1997ec-511d-4995-9976-e9e248a1ef92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Flow 'volume_create_manager' (9e3240eb-eefd-499f-a17a-550b03041d58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:55 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-8e906933-e2d2-489d-bc20-503af80f5a4e tempest-CreateVolumesFromSnapshotTest-164306734 None] Created volume successfully. Apr 21 02:11:56 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4c8f5c41-f1c3-48e3-9d02-6b491db59379 1073741824" returned: 0 in 0.456s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4c8f5c41-f1c3-48e3-9d02-6b491db59379 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:56 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4c8f5c41-f1c3-48e3-9d02-6b491db59379 Apr 21 02:11:56 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:56 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4c8f5c41-f1c3-48e3-9d02-6b491db59379" returned: 0 in 0.414s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:56 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:11:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5ae3d1-e38e-4352-9eba-a9ad52516060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c8f5c41-f1c3-48e3-9d02-6b491db59379', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e073ef56-4eb2-496f-809c-fc53420990fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:11:56 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Volume volume-4c8f5c41-f1c3-48e3-9d02-6b491db59379 (4c8f5c41-f1c3-48e3-9d02-6b491db59379): created successfully Apr 21 02:11:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e073ef56-4eb2-496f-809c-fc53420990fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:11:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Flow 'volume_create_manager' (81fbe34c-aa05-431a-b99b-bccd14837090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:11:56 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-5712f09c-76bc-4e7f-b0d5-21e0854164c7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Created volume successfully. Apr 21 02:11:57 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "cinder-4c8f5c41-f1c3-48e3-9d02-6b491db59379-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:57 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-4c8f5c41-f1c3-48e3-9d02-6b491db59379-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:57 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "cinder-quobyte-4c8f5c41-f1c3-48e3-9d02-6b491db59379" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:57 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-quobyte-4c8f5c41-f1c3-48e3-9d02-6b491db59379" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:57 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f48afa3-5b74-4589-9845-c19d487f1b04]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:11:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4c8f5c41-f1c3-48e3-9d02-6b491db59379 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:57 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4c8f5c41-f1c3-48e3-9d02-6b491db59379 Apr 21 02:11:57 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:57 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4c8f5c41-f1c3-48e3-9d02-6b491db59379" returned: 0 in 0.465s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:57 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4c8f5c41-f1c3-48e3-9d02-6b491db59379 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:57 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4c8f5c41-f1c3-48e3-9d02-6b491db59379 Apr 21 02:11:57 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:58 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4c8f5c41-f1c3-48e3-9d02-6b491db59379" returned: 0 in 0.392s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-quobyte-4c8f5c41-f1c3-48e3-9d02-6b491db59379" released by "delete_volume" :: held 0.882s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] Created reservations ['509e9400-ada6-4fa8-9eb3-2bcff5b918d5', '7ffe12d8-44c9-452d-a25d-9b977dfa4ee0', 'be0b8269-35cb-4e6c-a818-7a3e3da51563', 'f994f6af-8aa5-4a09-b158-477e282d4817'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:58 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:11:58 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "cinder-87f3a72d-35ac-4af7-b0d2-da17dce3eae1-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-87f3a72d-35ac-4af7-b0d2-da17dce3eae1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "cinder-quobyte-87f3a72d-35ac-4af7-b0d2-da17dce3eae1" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-quobyte-87f3a72d-35ac-4af7-b0d2-da17dce3eae1" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52e3675-4356-43c9-895e-d7bf6fefc954]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87f3a72d-35ac-4af7-b0d2-da17dce3eae1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:58 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87f3a72d-35ac-4af7-b0d2-da17dce3eae1 Apr 21 02:11:58 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:58 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.436s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:11:58 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] Deleted volume successfully. Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f8008d06-aa39-49c2-8fb6-e49103db3d6e tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-4c8f5c41-f1c3-48e3-9d02-6b491db59379-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:58 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87f3a72d-35ac-4af7-b0d2-da17dce3eae1" returned: 0 in 0.475s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87f3a72d-35ac-4af7-b0d2-da17dce3eae1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:58 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87f3a72d-35ac-4af7-b0d2-da17dce3eae1 Apr 21 02:11:58 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:59 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-87f3a72d-35ac-4af7-b0d2-da17dce3eae1" returned: 0 in 0.394s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-quobyte-87f3a72d-35ac-4af7-b0d2-da17dce3eae1" released by "delete_volume" :: held 0.888s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] Created reservations ['75384621-4d9b-49fa-b0c3-45ea6d3ae0ce', '890ff23d-3d7e-45ac-bb52-a6ff591894ff', '4b121246-6322-434f-87fd-d43ba48ef08f', 'cf65674a-e8ea-4e18-bffe-9295a09415fd'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:59 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:11:59 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "cinder-5179bd25-8fdd-420d-8643-5400665aaa34-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-5179bd25-8fdd-420d-8643-5400665aaa34-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "cinder-quobyte-5179bd25-8fdd-420d-8643-5400665aaa34" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-quobyte-5179bd25-8fdd-420d-8643-5400665aaa34" acquired by "delete_volume" :: waited 0.006s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be8f6b2-b2a1-4c76-858c-61cb1ce172e7]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5179bd25-8fdd-420d-8643-5400665aaa34 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:59 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5179bd25-8fdd-420d-8643-5400665aaa34 Apr 21 02:11:59 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:11:59 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.426s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:11:59 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] Deleted volume successfully. Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eef9df3e-8425-4320-8145-f33daaedae0e tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-87f3a72d-35ac-4af7-b0d2-da17dce3eae1-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:11:59 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5179bd25-8fdd-420d-8643-5400665aaa34" returned: 0 in 0.453s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:11:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5179bd25-8fdd-420d-8643-5400665aaa34 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:11:59 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5179bd25-8fdd-420d-8643-5400665aaa34 Apr 21 02:11:59 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:00 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5179bd25-8fdd-420d-8643-5400665aaa34" returned: 0 in 0.389s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-quobyte-5179bd25-8fdd-420d-8643-5400665aaa34" released by "delete_volume" :: held 0.862s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:00 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] Created reservations ['2d920fc1-f4f3-4019-aa4a-204304e1b103', 'e8d773ec-48fd-4de8-bdd7-f500f02d67d4', 'f98b9fda-9843-47b3-8496-63ed3cdf8f82', '10c33052-af4e-4873-b039-39c2beff4118'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:00 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:00 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "cinder-30bebd9a-5f7c-4f38-93dc-be8596f29a58-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-30bebd9a-5f7c-4f38-93dc-be8596f29a58-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "cinder-quobyte-30bebd9a-5f7c-4f38-93dc-be8596f29a58" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-quobyte-30bebd9a-5f7c-4f38-93dc-be8596f29a58" acquired by "delete_volume" :: waited 0.006s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:00 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[361d984c-5b30-48ea-859b-74f2c69c37a3]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-30bebd9a-5f7c-4f38-93dc-be8596f29a58 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:00 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-30bebd9a-5f7c-4f38-93dc-be8596f29a58 Apr 21 02:12:00 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:00 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.408s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:00 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:00 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] Deleted volume successfully. Apr 21 02:12:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4560d6c5-b6fa-4051-bee5-af282f626378 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-5179bd25-8fdd-420d-8643-5400665aaa34-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:01 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-30bebd9a-5f7c-4f38-93dc-be8596f29a58" returned: 0 in 0.450s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-30bebd9a-5f7c-4f38-93dc-be8596f29a58 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:01 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-30bebd9a-5f7c-4f38-93dc-be8596f29a58 Apr 21 02:12:01 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:01 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-30bebd9a-5f7c-4f38-93dc-be8596f29a58" returned: 0 in 0.386s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-quobyte-30bebd9a-5f7c-4f38-93dc-be8596f29a58" released by "delete_volume" :: held 0.854s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] Created reservations ['d2224958-8057-4cde-a062-a73b184d94b7', '9d615c4f-cac3-4a73-94eb-8c21544189ae', '543e9903-4309-44a1-929b-0ca899e1ed45', 'ad97894a-dc56-4eec-9dfe-009f40a73e85'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:01 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:01 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "cinder-f96c7570-535a-48d3-8b22-fc950abe3ee1-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-f96c7570-535a-48d3-8b22-fc950abe3ee1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "cinder-quobyte-f96c7570-535a-48d3-8b22-fc950abe3ee1" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-quobyte-f96c7570-535a-48d3-8b22-fc950abe3ee1" acquired by "delete_volume" :: waited 0.006s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c68492d-f35c-42e7-a199-52a1e31a3623]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f96c7570-535a-48d3-8b22-fc950abe3ee1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:01 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f96c7570-535a-48d3-8b22-fc950abe3ee1 Apr 21 02:12:01 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:01 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.411s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:01 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] Deleted volume successfully. Apr 21 02:12:01 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-90e89057-e472-49c7-94c4-8228192e2afd tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-30bebd9a-5f7c-4f38-93dc-be8596f29a58-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:02 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f96c7570-535a-48d3-8b22-fc950abe3ee1" returned: 0 in 0.464s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f96c7570-535a-48d3-8b22-fc950abe3ee1 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:02 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f96c7570-535a-48d3-8b22-fc950abe3ee1 Apr 21 02:12:02 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:02 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f96c7570-535a-48d3-8b22-fc950abe3ee1" returned: 0 in 0.410s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-quobyte-f96c7570-535a-48d3-8b22-fc950abe3ee1" released by "delete_volume" :: held 0.901s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] Created reservations ['9cc7b37d-dea1-4390-961d-18e0d6bcaee0', 'ed4da959-660e-4a79-9fde-998164358471', '809dfaf7-e60b-40db-b8a3-ddcec83152e7', '0483d90c-7840-48ef-9866-487f4c9336ae'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:02 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:02 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "cinder-fe45bd89-60bc-4e23-b6e5-e412772089c2-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-fe45bd89-60bc-4e23-b6e5-e412772089c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "cinder-quobyte-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-quobyte-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "cinder-quobyte-fe45bd89-60bc-4e23-b6e5-e412772089c2" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-quobyte-fe45bd89-60bc-4e23-b6e5-e412772089c2" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Deleting offline snapshot fe45bd89-60bc-4e23-b6e5-e412772089c2 of volume c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] snapshot_file for this snap is: volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cfe8ff-99cf-4395-8351-186ba584863d]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:02 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2 Apr 21 02:12:02 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:03 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.444s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:03 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:03 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] Deleted volume successfully. Apr 21 02:12:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3e6644a1-5c88-4659-b7a6-5f9b40e39283 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-f96c7570-535a-48d3-8b22-fc950abe3ee1-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:03 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2" returned: 0 in 0.470s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:12:03 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcdc997-dbca-4260-bd2d-adedc58fb0b5]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:03 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 Apr 21 02:12:03 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:03 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2" returned: 0 in 0.440s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:03 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2 Apr 21 02:12:03 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:04 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2" returned: 0 in 0.418s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:04 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2 Apr 21 02:12:04 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:04 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2.fe45bd89-60bc-4e23-b6e5-e412772089c2" returned: 0 in 0.411s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-quobyte-fe45bd89-60bc-4e23-b6e5-e412772089c2" released by "_delete_snapshot" :: held 1.789s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-quobyte-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2" released by "delete_snapshot" :: held 1.803s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:04 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Created reservations ['f22c2281-e31e-4fc1-86d9-db76c957664c', '2c69b06f-ba99-4231-9be9-4de6dbd1153f', 'edb25a1a-8e37-4573-bc5a-a3aa3eae3f03', 'a084c759-4d76-4248-81c5-2de755f7565b'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:04 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Delete snapshot completed successfully. Apr 21 02:12:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-69fe43bb-bb64-4320-aa53-f06d2bc8fdc7 tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-fe45bd89-60bc-4e23-b6e5-e412772089c2-delete_snapshot" released by "delete_snapshot" :: held 1.879s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "cinder-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "cinder-quobyte-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-quobyte-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:04 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[32eba86b-f55a-46b2-9b15-6ff9992e699b]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:05 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 Apr 21 02:12:05 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:05 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2" returned: 0 in 0.467s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:05 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2 Apr 21 02:12:05 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:05 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2" returned: 0 in 0.401s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-quobyte-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2" released by "delete_volume" :: held 0.905s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:05 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] Created reservations ['346c9b8e-8632-4132-ac93-0a10ac389a49', '4ee80896-b989-4ee0-b930-b26a00c3f872', 'a33a06c3-1c1d-4809-8c67-8fb13993a1f5', 'a0fd40e6-bed5-4721-81ac-485d410c11cf'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:05 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:05 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:06 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.436s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:06 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:06 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] Deleted volume successfully. Apr 21 02:12:06 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-467d7cb6-4a67-4bf8-bf5b-64779b8bbb6a tempest-CreateVolumesFromSnapshotTest-164306734 None] Lock "cinder-c3a65c76-9f2d-4e35-a1ea-5a0886d85dc2-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Flow 'volume_create_manager' (32ef396f-7c8f-4fb7-bc5d-06bbaaf16d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26873ea8-a7b3-438e-bb06-e3324fa0a190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26873ea8-a7b3-438e-bb06-e3324fa0a190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19eb4966-829d-47f4-bc60-74cc0cbd7527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60c597a45f14292ad748043796fe6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:07Z,use_quota=True,user_id='e13fa7ff9d7a4552804c28bca989bc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fea019-890f-4016-8eca-a8f4951c95e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fea019-890f-4016-8eca-a8f4951c95e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eda7ec0-c35f-4a42-9c46-200a0e6a1223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eda7ec0-c35f-4a42-9c46-200a0e6a1223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19eb4966-829d-47f4-bc60-74cc0cbd7527', 'volume_name': 'volume-19eb4966-829d-47f4-bc60-74cc0cbd7527', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892c5ab5-191c-4af9-98bf-f6305b9ee458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892c5ab5-191c-4af9-98bf-f6305b9ee458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5de927-d4e2-4dfc-9599-bb9b0bab37ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:07 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Volume 19eb4966-829d-47f4-bc60-74cc0cbd7527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19eb4966-829d-47f4-bc60-74cc0cbd7527', 'volume_size': 1} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19eb4966-829d-47f4-bc60-74cc0cbd7527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60c597a45f14292ad748043796fe6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:07Z,use_quota=True,user_id='e13fa7ff9d7a4552804c28bca989bc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Creating volume 19eb4966-829d-47f4-bc60-74cc0cbd7527 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:07 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:12:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-19eb4966-829d-47f4-bc60-74cc0cbd7527 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:07 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-19eb4966-829d-47f4-bc60-74cc0cbd7527 1073741824 Apr 21 02:12:07 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:08 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-19eb4966-829d-47f4-bc60-74cc0cbd7527 1073741824" returned: 0 in 0.465s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-19eb4966-829d-47f4-bc60-74cc0cbd7527 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:08 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-19eb4966-829d-47f4-bc60-74cc0cbd7527 Apr 21 02:12:08 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:08 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-19eb4966-829d-47f4-bc60-74cc0cbd7527" returned: 0 in 0.407s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:08 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:12:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:08 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5de927-d4e2-4dfc-9599-bb9b0bab37ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19eb4966-829d-47f4-bc60-74cc0cbd7527', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:08 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8835788b-5d79-40d1-9bf6-27c67632b9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:08 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Volume volume-19eb4966-829d-47f4-bc60-74cc0cbd7527 (19eb4966-829d-47f4-bc60-74cc0cbd7527): created successfully Apr 21 02:12:08 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8835788b-5d79-40d1-9bf6-27c67632b9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:08 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Flow 'volume_create_manager' (32ef396f-7c8f-4fb7-bc5d-06bbaaf16d41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:08 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-a311c051-08ba-4a85-8580-6c797ea4d46d tempest-CinderUnicodeTest-1086904719 None] Created volume successfully. Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Flow 'volume_create_manager' (2e7e5b2d-4e4b-4069-b99a-b45efce4f009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc61c63b-d09f-4b81-b21c-30bf68dc5e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc61c63b-d09f-4b81-b21c-30bf68dc5e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1137778345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db38dd6c-f388-4f28-9ca4-04b998c51787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60c597a45f14292ad748043796fe6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:10Z,use_quota=True,user_id='e13fa7ff9d7a4552804c28bca989bc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc08f5f-5745-4cc3-9df0-95b42a878990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc08f5f-5745-4cc3-9df0-95b42a878990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c847262f-0d92-4315-8333-e597ff2619ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c847262f-0d92-4315-8333-e597ff2619ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db38dd6c-f388-4f28-9ca4-04b998c51787', 'volume_name': 'volume-db38dd6c-f388-4f28-9ca4-04b998c51787', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b17913-2218-44d3-8a7a-68c134a83c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b17913-2218-44d3-8a7a-68c134a83c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320abd5d-5fc4-42f1-8896-9e6a2ddf2c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:09 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Volume db38dd6c-f388-4f28-9ca4-04b998c51787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db38dd6c-f388-4f28-9ca4-04b998c51787', 'volume_size': 1} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1137778345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db38dd6c-f388-4f28-9ca4-04b998c51787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60c597a45f14292ad748043796fe6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:10Z,use_quota=True,user_id='e13fa7ff9d7a4552804c28bca989bc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Creating volume db38dd6c-f388-4f28-9ca4-04b998c51787 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:09 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:12:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:09 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787 1073741824 Apr 21 02:12:09 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:10 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787 1073741824" returned: 0 in 0.448s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:10 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787 Apr 21 02:12:10 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:10 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787" returned: 0 in 0.408s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:10 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:12:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:10 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320abd5d-5fc4-42f1-8896-9e6a2ddf2c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db38dd6c-f388-4f28-9ca4-04b998c51787', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:10 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7dd947d-9b15-438d-8071-cc6bd1f32fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:10 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Volume volume-db38dd6c-f388-4f28-9ca4-04b998c51787 (db38dd6c-f388-4f28-9ca4-04b998c51787): created successfully Apr 21 02:12:10 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7dd947d-9b15-438d-8071-cc6bd1f32fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:10 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Flow 'volume_create_manager' (2e7e5b2d-4e4b-4069-b99a-b45efce4f009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:10 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-e1b6b715-91a1-4be3-92d4-8f82f3f3bf05 tempest-CinderUnicodeTest-1086904719 None] Created volume successfully. Apr 21 02:12:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:11 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] Creating offline snapshot c86a40a6-23eb-49f3-924b-16d78921b7d3 of volume db38dd6c-f388-4f28-9ca4-04b998c51787 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:12:11 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd12981e-27e9-40ee-92c0-81bc771a35d6]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:11 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787 Apr 21 02:12:11 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:11 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787" returned: 0 in 0.441s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:11 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3 1G Apr 21 02:12:11 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:12 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3 1G" returned: 0 in 0.460s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db38dd6c-f388-4f28-9ca4-04b998c51787 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:12 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db38dd6c-f388-4f28-9ca4-04b998c51787 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3 Apr 21 02:12:12 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:12 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db38dd6c-f388-4f28-9ca4-04b998c51787 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3" returned: 0 in 0.404s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:12 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3 is being set with open permissions: ugo+rw Apr 21 02:12:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:12 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3 Apr 21 02:12:12 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:12 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3" returned: 0 in 0.404s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:12 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.info Apr 21 02:12:12 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:13 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.info" returned: 0 in 0.399s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:13 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.info is being set with open permissions: ugo+rw Apr 21 02:12:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:13 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.info Apr 21 02:12:13 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:13 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.info" returned: 0 in 0.395s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:13 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-2f5b33b1-6104-44c2-8e45-981559c9cf3d tempest-CinderUnicodeTest-1086904719 None] Create snapshot completed successfully Apr 21 02:12:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] Acquiring lock "cinder-c86a40a6-23eb-49f3-924b-16d78921b7d3-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] Lock "cinder-c86a40a6-23eb-49f3-924b-16d78921b7d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] Acquiring lock "cinder-quobyte-db38dd6c-f388-4f28-9ca4-04b998c51787" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] Lock "cinder-quobyte-db38dd6c-f388-4f28-9ca4-04b998c51787" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] Acquiring lock "cinder-quobyte-c86a40a6-23eb-49f3-924b-16d78921b7d3" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] Lock "cinder-quobyte-c86a40a6-23eb-49f3-924b-16d78921b7d3" acquired by "_delete_snapshot" :: waited 0.004s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] Deleting offline snapshot c86a40a6-23eb-49f3-924b-16d78921b7d3 of volume db38dd6c-f388-4f28-9ca4-04b998c51787 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:12:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] snapshot_file for this snap is: volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:12:14 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[26aa7ded-1818-41ea-8ea6-5f2ee6524822]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:14 devstack sudo[90004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3 Apr 21 02:12:14 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:14 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3" returned: 0 in 0.458s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:14 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db38dd6c-f388-4f28-9ca4-04b998c51787(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:12:14 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ddc50f-7d4b-4a6d-9c5a-0f11fac7808d]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:14 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787 Apr 21 02:12:14 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:15 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787" returned: 0 in 0.459s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:15 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3 Apr 21 02:12:15 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:15 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3" returned: 0 in 0.426s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:15 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3 Apr 21 02:12:15 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:16 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787.c86a40a6-23eb-49f3-924b-16d78921b7d3" returned: 0 in 0.410s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] Lock "cinder-quobyte-c86a40a6-23eb-49f3-924b-16d78921b7d3" released by "_delete_snapshot" :: held 1.807s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] Lock "cinder-quobyte-db38dd6c-f388-4f28-9ca4-04b998c51787" released by "delete_snapshot" :: held 1.815s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:16 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] Created reservations ['afa7a85a-b2f5-4e41-91f6-04bd255f72cc', 'bba6347d-bc1a-4b5b-94ce-236d3d810a6c', '26e28feb-e56a-4f0e-b51f-95a387f18b6e', '41770d8b-0bca-46ce-b8a7-449755e04524'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:16 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] Delete snapshot completed successfully. Apr 21 02:12:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-a3656942-61af-4630-99d0-87e9d684fb91 tempest-CinderUnicodeTest-1086904719 None] Lock "cinder-c86a40a6-23eb-49f3-924b-16d78921b7d3-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] Acquiring lock "cinder-db38dd6c-f388-4f28-9ca4-04b998c51787-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] Lock "cinder-db38dd6c-f388-4f28-9ca4-04b998c51787-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] Acquiring lock "cinder-quobyte-db38dd6c-f388-4f28-9ca4-04b998c51787" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] Lock "cinder-quobyte-db38dd6c-f388-4f28-9ca4-04b998c51787" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:16 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1af6bf1-eb71-4b76-b8d9-a17808ccb60e]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:16 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787 Apr 21 02:12:16 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:16 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787" returned: 0 in 0.451s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:16 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787 Apr 21 02:12:16 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:17 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-db38dd6c-f388-4f28-9ca4-04b998c51787" returned: 0 in 0.400s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] Lock "cinder-quobyte-db38dd6c-f388-4f28-9ca4-04b998c51787" released by "delete_volume" :: held 0.881s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:17 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] Created reservations ['84e47140-f483-4668-ab0d-b7c3b591fdfe', '97b171a6-5a05-48ca-892b-7ecfaed02526', '0aad5985-a1a1-4231-98b7-9f313d60deed', '0bbe29fd-5676-49cc-82a6-92976c7f747a'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:17 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:17 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] Acquiring lock "cinder-19eb4966-829d-47f4-bc60-74cc0cbd7527-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] Lock "cinder-19eb4966-829d-47f4-bc60-74cc0cbd7527-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] Acquiring lock "cinder-quobyte-19eb4966-829d-47f4-bc60-74cc0cbd7527" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] Lock "cinder-quobyte-19eb4966-829d-47f4-bc60-74cc0cbd7527" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:17 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dd864a-d521-4da1-af88-c6baf997dfd1]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-19eb4966-829d-47f4-bc60-74cc0cbd7527 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:17 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-19eb4966-829d-47f4-bc60-74cc0cbd7527 Apr 21 02:12:17 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:17 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.412s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:17 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:17 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] Deleted volume successfully. Apr 21 02:12:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-62d22317-147e-44a0-bd47-42dd19dd98f9 tempest-CinderUnicodeTest-1086904719 None] Lock "cinder-db38dd6c-f388-4f28-9ca4-04b998c51787-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:17 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-19eb4966-829d-47f4-bc60-74cc0cbd7527" returned: 0 in 0.477s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-19eb4966-829d-47f4-bc60-74cc0cbd7527 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:18 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-19eb4966-829d-47f4-bc60-74cc0cbd7527 Apr 21 02:12:18 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:18 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-19eb4966-829d-47f4-bc60-74cc0cbd7527" returned: 0 in 0.390s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:18 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] Lock "cinder-quobyte-19eb4966-829d-47f4-bc60-74cc0cbd7527" released by "delete_volume" :: held 0.888s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:18 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] Created reservations ['28f594de-1d0a-4c8e-bfb1-27f35dcb9ace', '605a885c-a463-4ec8-9fc0-d4e6852038b1', '62366e49-85f0-4a36-94c2-32acdb4fa570', 'ea9f6397-a6a3-49dd-85d7-4918fa98b6a4'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:18 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:18 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:18 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.425s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:18 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:18 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] Deleted volume successfully. Apr 21 02:12:18 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-f22e4c84-437c-4a07-add0-7aee74a2cd1d tempest-CinderUnicodeTest-1086904719 None] Lock "cinder-19eb4966-829d-47f4-bc60-74cc0cbd7527-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Flow 'volume_create_manager' (b6cc89a7-e2b4-4171-a8a1-0ec070c0e65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ea1ece-7b4c-4ce7-bd89-ec6c52df85fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ea1ece-7b4c-4ce7-bd89-ec6c52df85fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-759755310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd199d97-6ae5-40e2-a86f-7d9605fa4b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331da0ca554b4618bce46447beac6a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:26Z,use_quota=True,user_id='27678b4df8754626909cf07c6678901a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c5b1e7-2546-4407-9ccf-c22adc02376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c5b1e7-2546-4407-9ccf-c22adc02376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1a97f1-858b-4ca5-a760-08e3da0d7473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1a97f1-858b-4ca5-a760-08e3da0d7473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd199d97-6ae5-40e2-a86f-7d9605fa4b38', 'volume_name': 'volume-cd199d97-6ae5-40e2-a86f-7d9605fa4b38', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2b495b-eee3-4179-8778-93e12f3b1d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2b495b-eee3-4179-8778-93e12f3b1d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd17cd74-83df-44c0-9cf6-b1361e36b225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:25 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Volume cd199d97-6ae5-40e2-a86f-7d9605fa4b38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd199d97-6ae5-40e2-a86f-7d9605fa4b38', 'volume_size': 1} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-759755310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd199d97-6ae5-40e2-a86f-7d9605fa4b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331da0ca554b4618bce46447beac6a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:26Z,use_quota=True,user_id='27678b4df8754626909cf07c6678901a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Creating volume cd199d97-6ae5-40e2-a86f-7d9605fa4b38 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:25 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd199d97-6ae5-40e2-a86f-7d9605fa4b38 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:25 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd199d97-6ae5-40e2-a86f-7d9605fa4b38 1073741824 Apr 21 02:12:25 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Flow 'volume_create_manager' (dc41b2f3-75ca-4ce1-abd4-ed3ccaa73b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c3b6acf-1e08-4692-b386-bdc93d8d186d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c3b6acf-1e08-4692-b386-bdc93d8d186d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1210006150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d65a88f-2ff9-4ee5-807a-e1b70b58d65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ab1da15bfb43dc992051fe3b766163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:26Z,use_quota=True,user_id='adb8ec535ec2419fa0e1444021c2c7b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e6147c-f011-4137-ba64-1186c7a057cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e6147c-f011-4137-ba64-1186c7a057cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3234c4f-fa6a-49d3-9269-46bce493b96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3234c4f-fa6a-49d3-9269-46bce493b96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d65a88f-2ff9-4ee5-807a-e1b70b58d65c', 'volume_name': 'volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0321db-f61e-4c0e-a5fe-2ae01586856a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0321db-f61e-4c0e-a5fe-2ae01586856a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357db26f-9dee-4f98-bf51-2600401822f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:25 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Volume 0d65a88f-2ff9-4ee5-807a-e1b70b58d65c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c', 'volume_size': 1} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:25 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Flow 'volume_create_manager' (07c019f7-f4b2-4dc8-b766-53ebcf20e5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba3d8f6-c266-4f04-9464-f674c82f60f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba3d8f6-c266-4f04-9464-f674c82f60f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-425322305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d927068-f5ab-4da1-a4cd-262d0176bed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331da0ca554b4618bce46447beac6a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:26Z,use_quota=True,user_id='27678b4df8754626909cf07c6678901a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a02930-7533-48c2-b0da-508741e554c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a02930-7533-48c2-b0da-508741e554c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad41b789-fbb3-43ac-a462-75808a80108c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad41b789-fbb3-43ac-a462-75808a80108c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d927068-f5ab-4da1-a4cd-262d0176bed3', 'volume_name': 'volume-4d927068-f5ab-4da1-a4cd-262d0176bed3', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc18aab-1603-4acf-8c6a-d28b2afd6304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc18aab-1603-4acf-8c6a-d28b2afd6304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c3a71d-38ea-4da9-bd59-d004f05abe07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Volume 4d927068-f5ab-4da1-a4cd-262d0176bed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d927068-f5ab-4da1-a4cd-262d0176bed3', 'volume_size': 1} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Flow 'volume_create_manager' (88354f56-c20b-4b18-971f-8ef245e30db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3100c01-831f-4854-9adf-15c5292bfe9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3100c01-831f-4854-9adf-15c5292bfe9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-95626700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211cc2c3-2299-4887-be45-59995a42086b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7538b079b44f6a811f67a19ef62c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:26Z,use_quota=True,user_id='04492d678a554fdd93bd002ae8792297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7fa12b6-57d1-4e78-abc0-c801b8db7912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7fa12b6-57d1-4e78-abc0-c801b8db7912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c02c9e1-bcf6-4c78-8bc0-7f66fa05eeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c02c9e1-bcf6-4c78-8bc0-7f66fa05eeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '211cc2c3-2299-4887-be45-59995a42086b', 'volume_name': 'volume-211cc2c3-2299-4887-be45-59995a42086b', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78eefb7-3076-4bdd-a6bc-397182a0afd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78eefb7-3076-4bdd-a6bc-397182a0afd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dc34db-f64f-4a2b-a355-6c61965df20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Volume 211cc2c3-2299-4887-be45-59995a42086b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-211cc2c3-2299-4887-be45-59995a42086b', 'volume_size': 1} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Flow 'volume_create_manager' (6f6de7f7-9839-4094-b3db-c6bbfd1f3a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0187a26c-fb93-4a61-8412-6c6306c8cbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0187a26c-fb93-4a61-8412-6c6306c8cbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-877824250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67de9289-067b-4868-a20e-948538ef1703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331da0ca554b4618bce46447beac6a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:26Z,use_quota=True,user_id='27678b4df8754626909cf07c6678901a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44dbde57-10e7-447a-b2d4-5d22d833435f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44dbde57-10e7-447a-b2d4-5d22d833435f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0d4d50-8ec0-4337-b9af-d99464081361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0d4d50-8ec0-4337-b9af-d99464081361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67de9289-067b-4868-a20e-948538ef1703', 'volume_name': 'volume-67de9289-067b-4868-a20e-948538ef1703', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f0f895-a71b-47fa-a94a-811cf8d6c633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f0f895-a71b-47fa-a94a-811cf8d6c633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb544ed6-38bf-4003-8540-0412b41c5b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Volume 67de9289-067b-4868-a20e-948538ef1703: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67de9289-067b-4868-a20e-948538ef1703', 'volume_size': 1} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:26 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd199d97-6ae5-40e2-a86f-7d9605fa4b38 1073741824" returned: 0 in 0.689s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd199d97-6ae5-40e2-a86f-7d9605fa4b38 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:26 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd199d97-6ae5-40e2-a86f-7d9605fa4b38 Apr 21 02:12:26 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Flow 'volume_create_manager' (52aa8af6-79b6-46be-ab23-765f71243536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23034da8-30c2-4168-b868-c9ac087f5e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23034da8-30c2-4168-b868-c9ac087f5e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1168533601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c01295-fba3-4b28-a538-8f7bfc5ff7a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331da0ca554b4618bce46447beac6a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:26Z,use_quota=True,user_id='27678b4df8754626909cf07c6678901a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53c3502-c0a3-4e8b-ad84-99af953a2d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53c3502-c0a3-4e8b-ad84-99af953a2d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e101e8fb-882e-45cb-86e0-aa9d9fc7705e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e101e8fb-882e-45cb-86e0-aa9d9fc7705e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62c01295-fba3-4b28-a538-8f7bfc5ff7a0', 'volume_name': 'volume-62c01295-fba3-4b28-a538-8f7bfc5ff7a0', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97be7c31-1325-4b61-8466-381881f358e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97be7c31-1325-4b61-8466-381881f358e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930013ee-4531-4d2d-803d-8ee37c412414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Volume 62c01295-fba3-4b28-a538-8f7bfc5ff7a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62c01295-fba3-4b28-a538-8f7bfc5ff7a0', 'volume_size': 1} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Flow 'volume_create_manager' (7dc4a1dc-e634-4ecb-9772-228238847ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419bc907-1dbf-42f1-b7bc-7c9c6902071a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419bc907-1dbf-42f1-b7bc-7c9c6902071a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-91577126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0e7ca7-2be6-427f-9a8e-d81cedc9841f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331da0ca554b4618bce46447beac6a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:27Z,use_quota=True,user_id='27678b4df8754626909cf07c6678901a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60d9c7f-71a1-4a88-a416-81d1b2f7f5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60d9c7f-71a1-4a88-a416-81d1b2f7f5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a665068a-bd31-46b7-b496-c2986a305710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a665068a-bd31-46b7-b496-c2986a305710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e0e7ca7-2be6-427f-9a8e-d81cedc9841f', 'volume_name': 'volume-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94422e6f-f904-455f-8a92-aa7861731ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94422e6f-f904-455f-8a92-aa7861731ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465bcbf1-9fa8-4ac9-b6d6-f95189ddc5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:26 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Volume 5e0e7ca7-2be6-427f-9a8e-d81cedc9841f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f', 'volume_size': 1} Apr 21 02:12:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:27 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd199d97-6ae5-40e2-a86f-7d9605fa4b38" returned: 0 in 0.501s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.086s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1210006150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d65a88f-2ff9-4ee5-807a-e1b70b58d65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ab1da15bfb43dc992051fe3b766163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:26Z,use_quota=True,user_id='adb8ec535ec2419fa0e1444021c2c7b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Creating volume 0d65a88f-2ff9-4ee5-807a-e1b70b58d65c {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:27 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd17cd74-83df-44c0-9cf6-b1361e36b225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd199d97-6ae5-40e2-a86f-7d9605fa4b38', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b987825-49f9-4e0b-925c-353dc930adfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:27 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c 1073741824 Apr 21 02:12:27 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:27 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Volume volume-cd199d97-6ae5-40e2-a86f-7d9605fa4b38 (cd199d97-6ae5-40e2-a86f-7d9605fa4b38): created successfully Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b987825-49f9-4e0b-925c-353dc930adfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Flow 'volume_create_manager' (b6cc89a7-e2b4-4171-a8a1-0ec070c0e65d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:27 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-94b899e4-c339-4930-bb3e-d759bf0abb01 tempest-CreateVolumesFromImageTest-368972753 None] Created volume successfully. Apr 21 02:12:27 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c 1073741824" returned: 0 in 0.481s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:27 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c Apr 21 02:12:27 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:27 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c" returned: 0 in 0.424s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.901s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-425322305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d927068-f5ab-4da1-a4cd-262d0176bed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331da0ca554b4618bce46447beac6a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:26Z,use_quota=True,user_id='27678b4df8754626909cf07c6678901a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Creating volume 4d927068-f5ab-4da1-a4cd-262d0176bed3 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:27 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d927068-f5ab-4da1-a4cd-262d0176bed3 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357db26f-9dee-4f98-bf51-2600401822f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:27 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea190a4-a32c-4e15-ad4c-52511bc1cafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:28 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d927068-f5ab-4da1-a4cd-262d0176bed3 1073741824 Apr 21 02:12:28 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:28 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Volume volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c (0d65a88f-2ff9-4ee5-807a-e1b70b58d65c): created successfully Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea190a4-a32c-4e15-ad4c-52511bc1cafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Flow 'volume_create_manager' (dc41b2f3-75ca-4ce1-abd4-ed3ccaa73b5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:28 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-20c4836a-b0f8-42a5-9a6c-0fc2d975bee2 tempest-VolumeDependencyTests-952227776 None] Created volume successfully. Apr 21 02:12:28 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d927068-f5ab-4da1-a4cd-262d0176bed3 1073741824" returned: 0 in 0.488s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d927068-f5ab-4da1-a4cd-262d0176bed3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:28 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d927068-f5ab-4da1-a4cd-262d0176bed3 Apr 21 02:12:28 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:28 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d927068-f5ab-4da1-a4cd-262d0176bed3" returned: 0 in 0.438s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.739s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-95626700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211cc2c3-2299-4887-be45-59995a42086b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7538b079b44f6a811f67a19ef62c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:26Z,use_quota=True,user_id='04492d678a554fdd93bd002ae8792297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Creating volume 211cc2c3-2299-4887-be45-59995a42086b {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:28 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-211cc2c3-2299-4887-be45-59995a42086b 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c3a71d-38ea-4da9-bd59-d004f05abe07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d927068-f5ab-4da1-a4cd-262d0176bed3', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:28 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-211cc2c3-2299-4887-be45-59995a42086b 1073741824 Apr 21 02:12:28 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12bfe07-713a-4f66-a813-47d0b360f691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:28 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Volume volume-4d927068-f5ab-4da1-a4cd-262d0176bed3 (4d927068-f5ab-4da1-a4cd-262d0176bed3): created successfully Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12bfe07-713a-4f66-a813-47d0b360f691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:28 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Flow 'volume_create_manager' (07c019f7-f4b2-4dc8-b766-53ebcf20e5e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:28 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-9d75b33e-14da-46eb-a6fb-1497d4bd64c3 tempest-CreateVolumesFromImageTest-368972753 None] Created volume successfully. Apr 21 02:12:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:29 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-211cc2c3-2299-4887-be45-59995a42086b 1073741824" returned: 0 in 0.545s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-211cc2c3-2299-4887-be45-59995a42086b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:29 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-211cc2c3-2299-4887-be45-59995a42086b Apr 21 02:12:29 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:29 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-211cc2c3-2299-4887-be45-59995a42086b" returned: 0 in 0.449s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:29 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:12:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.587s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:29 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-877824250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67de9289-067b-4868-a20e-948538ef1703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331da0ca554b4618bce46447beac6a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:26Z,use_quota=True,user_id='27678b4df8754626909cf07c6678901a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:12:29 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Creating volume 67de9289-067b-4868-a20e-948538ef1703 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:12:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:29 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:29 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:29 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:29 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:12:29 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-67de9289-067b-4868-a20e-948538ef1703 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:29 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dc34db-f64f-4a2b-a355-6c61965df20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-211cc2c3-2299-4887-be45-59995a42086b', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:29 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-67de9289-067b-4868-a20e-948538ef1703 1073741824 Apr 21 02:12:29 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:29 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a423a36f-5000-4b3c-b1d7-bb04935562c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:30 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Volume volume-211cc2c3-2299-4887-be45-59995a42086b (211cc2c3-2299-4887-be45-59995a42086b): created successfully Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a423a36f-5000-4b3c-b1d7-bb04935562c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Flow 'volume_create_manager' (88354f56-c20b-4b18-971f-8ef245e30db3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:30 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-23836368-63b7-496c-8143-5490b7551c88 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Created volume successfully. Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Flow 'volume_create_manager' (25c6d7b6-7180-45aa-b768-35ee199f86f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:30 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d1e998-c1da-4f69-9ecf-589db132cefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-67de9289-067b-4868-a20e-948538ef1703 1073741824" returned: 0 in 0.607s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d1e998-c1da-4f69-9ecf-589db132cefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1021178282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc413f84-b22e-4d3d-a7cf-c2de4c2a4135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7538b079b44f6a811f67a19ef62c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:30Z,use_quota=True,user_id='04492d678a554fdd93bd002ae8792297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad3e49c-9d7f-4389-9c2b-4b6124c96d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad3e49c-9d7f-4389-9c2b-4b6124c96d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b915d4-89bd-49ac-95f1-dac9153281bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b915d4-89bd-49ac-95f1-dac9153281bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc413f84-b22e-4d3d-a7cf-c2de4c2a4135', 'volume_name': 'volume-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8111a94-dba1-4e98-9b39-a1907091b8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8111a94-dba1-4e98-9b39-a1907091b8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8c957d-5881-44f4-bfc8-cf470a4b2453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:30 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Volume fc413f84-b22e-4d3d-a7cf-c2de4c2a4135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135', 'volume_size': 1} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-67de9289-067b-4868-a20e-948538ef1703 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:30 devstack sudo[90124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-67de9289-067b-4868-a20e-948538ef1703 Apr 21 02:12:30 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Flow 'volume_create_manager' (3f33b647-fcae-45db-9987-a6e0cfba90ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de202478-526b-48da-a305-ff05034617cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de202478-526b-48da-a305-ff05034617cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1897912912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e56f91-503d-41aa-9c13-26b727f9e94e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7538b079b44f6a811f67a19ef62c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:31Z,use_quota=True,user_id='04492d678a554fdd93bd002ae8792297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff118f9d-de9b-41e6-8acb-eb53fd37bb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff118f9d-de9b-41e6-8acb-eb53fd37bb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29e83ce-8e26-4fb0-9d7f-1147134bb827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29e83ce-8e26-4fb0-9d7f-1147134bb827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28e56f91-503d-41aa-9c13-26b727f9e94e', 'volume_name': 'volume-28e56f91-503d-41aa-9c13-26b727f9e94e', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239f99ba-853c-491e-86cc-6ed0f0eb2e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239f99ba-853c-491e-86cc-6ed0f0eb2e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc31a11b-c46a-448c-a1fe-73461e1c3ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:30 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Volume 28e56f91-503d-41aa-9c13-26b727f9e94e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28e56f91-503d-41aa-9c13-26b727f9e94e', 'volume_size': 1} Apr 21 02:12:30 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Flow 'volume_create_manager' (522e932f-1f20-4ffa-a004-ffbe6fb56222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa815345-460a-44bf-bf8d-9b26b001453b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa815345-460a-44bf-bf8d-9b26b001453b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-431439843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab32012-2693-4d5f-951e-47f45a0c5f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7538b079b44f6a811f67a19ef62c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:31Z,use_quota=True,user_id='04492d678a554fdd93bd002ae8792297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132272d2-44be-4403-96e5-3220a64a591a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132272d2-44be-4403-96e5-3220a64a591a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7dafb1f-7b22-4183-9e4f-65ea6afe31be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7dafb1f-7b22-4183-9e4f-65ea6afe31be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ab32012-2693-4d5f-951e-47f45a0c5f95', 'volume_name': 'volume-9ab32012-2693-4d5f-951e-47f45a0c5f95', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717f3fd5-cfaf-43aa-a025-0b02f07318e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717f3fd5-cfaf-43aa-a025-0b02f07318e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7068c7-85e2-4f01-961e-3d0bf367c4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:31 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Volume 9ab32012-2693-4d5f-951e-47f45a0c5f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ab32012-2693-4d5f-951e-47f45a0c5f95', 'volume_size': 1} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:31 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-67de9289-067b-4868-a20e-948538ef1703" returned: 0 in 0.595s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.620s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1168533601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c01295-fba3-4b28-a538-8f7bfc5ff7a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331da0ca554b4618bce46447beac6a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:26Z,use_quota=True,user_id='27678b4df8754626909cf07c6678901a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Creating volume 62c01295-fba3-4b28-a538-8f7bfc5ff7a0 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:31 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-62c01295-fba3-4b28-a538-8f7bfc5ff7a0 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb544ed6-38bf-4003-8540-0412b41c5b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67de9289-067b-4868-a20e-948538ef1703', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d740c7-8e95-40a8-9980-4569a399c7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:31 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-62c01295-fba3-4b28-a538-8f7bfc5ff7a0 1073741824 Apr 21 02:12:31 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:31 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Volume volume-67de9289-067b-4868-a20e-948538ef1703 (67de9289-067b-4868-a20e-948538ef1703): created successfully Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d740c7-8e95-40a8-9980-4569a399c7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Flow 'volume_create_manager' (6f6de7f7-9839-4094-b3db-c6bbfd1f3a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Flow 'volume_create_manager' (7555c1ad-dd16-4a09-bce6-3eb34e464b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e2ec28-6f11-4471-8356-844f6953d4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e2ec28-6f11-4471-8356-844f6953d4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-922363450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469b1def-207f-43f6-ad39-2fdadcc38893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7538b079b44f6a811f67a19ef62c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:31Z,use_quota=True,user_id='04492d678a554fdd93bd002ae8792297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22aa0c1a-4c94-4c1c-9a52-04aad997b9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22aa0c1a-4c94-4c1c-9a52-04aad997b9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2125716a-78ef-4793-8831-c7f649fa9934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2125716a-78ef-4793-8831-c7f649fa9934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '469b1def-207f-43f6-ad39-2fdadcc38893', 'volume_name': 'volume-469b1def-207f-43f6-ad39-2fdadcc38893', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff38d63f-4e20-4cd7-ad8f-c6eb2e9bc153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff38d63f-4e20-4cd7-ad8f-c6eb2e9bc153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b4a643-2fe4-4fd3-80c3-997ab1fafae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:31 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Volume 469b1def-207f-43f6-ad39-2fdadcc38893: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-469b1def-207f-43f6-ad39-2fdadcc38893', 'volume_size': 1} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:31 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-6d40d3d0-4bb8-4b37-a7ae-eb38cb6e7f47 tempest-CreateVolumesFromImageTest-368972753 None] Created volume successfully. Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Flow 'volume_create_manager' (111d6c63-6a0d-4532-9070-4bfa6d64d14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f2f2f8-6c7b-4cbf-9b50-75b0f7a8721f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f2f2f8-6c7b-4cbf-9b50-75b0f7a8721f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-434080290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f73c43e9-dffd-427d-be10-ab94cd0b443e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7538b079b44f6a811f67a19ef62c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:32Z,use_quota=True,user_id='04492d678a554fdd93bd002ae8792297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731c3d1e-d411-4be3-8b2b-3e7adef6b864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731c3d1e-d411-4be3-8b2b-3e7adef6b864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604d712f-a8cc-4c44-9afd-47675a6f4c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604d712f-a8cc-4c44-9afd-47675a6f4c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f73c43e9-dffd-427d-be10-ab94cd0b443e', 'volume_name': 'volume-f73c43e9-dffd-427d-be10-ab94cd0b443e', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895b215a-99d1-4000-80bb-953e2081556b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895b215a-99d1-4000-80bb-953e2081556b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f18ea1-d354-4545-9b38-a4a21da135c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:31 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Volume f73c43e9-dffd-427d-be10-ab94cd0b443e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f73c43e9-dffd-427d-be10-ab94cd0b443e', 'volume_size': 1} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:31 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-62c01295-fba3-4b28-a538-8f7bfc5ff7a0 1073741824" returned: 0 in 0.554s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:31 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-62c01295-fba3-4b28-a538-8f7bfc5ff7a0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:31 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-62c01295-fba3-4b28-a538-8f7bfc5ff7a0 Apr 21 02:12:31 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:32 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-62c01295-fba3-4b28-a538-8f7bfc5ff7a0" returned: 0 in 0.533s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.577s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-91577126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0e7ca7-2be6-427f-9a8e-d81cedc9841f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331da0ca554b4618bce46447beac6a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:27Z,use_quota=True,user_id='27678b4df8754626909cf07c6678901a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Creating volume 5e0e7ca7-2be6-427f-9a8e-d81cedc9841f {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:32 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930013ee-4531-4d2d-803d-8ee37c412414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62c01295-fba3-4b28-a538-8f7bfc5ff7a0', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:32 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f 1073741824 Apr 21 02:12:32 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af02b076-f27e-4d8b-881d-5469cfc56304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:32 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Volume volume-62c01295-fba3-4b28-a538-8f7bfc5ff7a0 (62c01295-fba3-4b28-a538-8f7bfc5ff7a0): created successfully Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af02b076-f27e-4d8b-881d-5469cfc56304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Flow 'volume_create_manager' (52aa8af6-79b6-46be-ab23-765f71243536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:32 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-6ac0539e-d796-46d0-ba5b-f4f29891662f tempest-CreateVolumesFromImageTest-368972753 None] Created volume successfully. Apr 21 02:12:32 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f 1073741824" returned: 0 in 0.538s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:32 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:32 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f Apr 21 02:12:32 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:33 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f" returned: 0 in 0.451s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:33 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:12:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.158s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:33 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465bcbf1-9fa8-4ac9-b6d6-f95189ddc5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:33 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155b6ca4-7417-487a-a925-b6582e169adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:33 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] Creating offline snapshot da09e09c-2320-4244-b86d-714efd40623f of volume 0d65a88f-2ff9-4ee5-807a-e1b70b58d65c {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:12:33 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Volume volume-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f (5e0e7ca7-2be6-427f-9a8e-d81cedc9841f): created successfully Apr 21 02:12:33 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155b6ca4-7417-487a-a925-b6582e169adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:33 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Flow 'volume_create_manager' (7dc4a1dc-e634-4ecb-9772-228238847ce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:33 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe2d4b3-1ac5-4088-a6c3-f380dad76950]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:33 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-539ad951-14c0-4e74-a89d-4cdac92573e7 tempest-CreateVolumesFromImageTest-368972753 None] Created volume successfully. Apr 21 02:12:33 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c Apr 21 02:12:33 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:33 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c" returned: 0 in 0.505s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:33 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:33 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f 1G Apr 21 02:12:33 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:34 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "cinder-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:34 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:34 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f 1G" returned: 0 in 0.524s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:34 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f Apr 21 02:12:34 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:34 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "cinder-quobyte-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:34 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-quobyte-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:34 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4806eb-69da-477f-a06e-0d8ddd34d23e]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:34 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f Apr 21 02:12:34 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:34 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f" returned: 0 in 0.443s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:34 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f is being set with open permissions: ugo+rw Apr 21 02:12:34 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:34 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f Apr 21 02:12:34 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:35 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f" returned: 0 in 0.495s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:35 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f Apr 21 02:12:35 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:35 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f" returned: 0 in 0.449s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:35 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.info Apr 21 02:12:35 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:35 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f" returned: 0 in 0.456s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-quobyte-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f" released by "delete_volume" :: held 0.973s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] Created reservations ['d7ab1757-6888-447f-9add-a5dcd9ea9a98', '3e052892-78c5-4463-a33b-fce9d51353a0', '4052be2e-12e6-4fe9-ae71-e5f5bea95daa', '81e43f44-fa75-45ba-a4b0-0be11cc43714'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:35 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:35 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "cinder-62c01295-fba3-4b28-a538-8f7bfc5ff7a0-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-62c01295-fba3-4b28-a538-8f7bfc5ff7a0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "cinder-quobyte-62c01295-fba3-4b28-a538-8f7bfc5ff7a0" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-quobyte-62c01295-fba3-4b28-a538-8f7bfc5ff7a0" acquired by "delete_volume" :: waited 0.019s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fe7e82-b648-4c3b-99cd-0d80fedeb98c]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-62c01295-fba3-4b28-a538-8f7bfc5ff7a0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:35 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-62c01295-fba3-4b28-a538-8f7bfc5ff7a0 Apr 21 02:12:35 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:35 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.info" returned: 0 in 0.522s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:35 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.info is being set with open permissions: ugo+rw Apr 21 02:12:35 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:35 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.info Apr 21 02:12:35 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:36 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.495s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:36 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] Deleted volume successfully. Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-78162e0d-5650-44e4-95b1-d433cbe70500 tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-5e0e7ca7-2be6-427f-9a8e-d81cedc9841f-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:36 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-62c01295-fba3-4b28-a538-8f7bfc5ff7a0" returned: 0 in 0.513s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-62c01295-fba3-4b28-a538-8f7bfc5ff7a0 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:36 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-62c01295-fba3-4b28-a538-8f7bfc5ff7a0 Apr 21 02:12:36 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:36 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.info" returned: 0 in 0.468s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.756s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1021178282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc413f84-b22e-4d3d-a7cf-c2de4c2a4135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7538b079b44f6a811f67a19ef62c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:30Z,use_quota=True,user_id='04492d678a554fdd93bd002ae8792297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Creating volume fc413f84-b22e-4d3d-a7cf-c2de4c2a4135 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:36 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:36 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-585f8ac5-70e3-443f-9d68-096ec4d57c1d tempest-VolumeDependencyTests-952227776 None] Create snapshot completed successfully Apr 21 02:12:36 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135 1073741824 Apr 21 02:12:36 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:36 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-62c01295-fba3-4b28-a538-8f7bfc5ff7a0" returned: 0 in 0.475s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-quobyte-62c01295-fba3-4b28-a538-8f7bfc5ff7a0" released by "delete_volume" :: held 1.010s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] Created reservations ['3f5735c2-2313-4c9e-88dc-c0b57b821e89', '3118c264-c540-491c-afe0-0c5542314b21', '4365772e-958f-44b4-9733-7bdf4592c9e5', 'c5425b1c-5da8-45ad-833f-6f41c4c20d47'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:36 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:36 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:36 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:37 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135 1073741824" returned: 0 in 0.661s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:SELECT=134,cinder:UPDATE=155,cinder:DELETE=13,cinder:INSERT=39 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:SELECT=112,cinder:UPDATE=168,cinder:INSERT=37,cinder:DELETE=17 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:37 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135 Apr 21 02:12:37 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:37 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.520s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:37 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] Deleted volume successfully. Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-775ceac6-f46d-4983-87b5-dec439d2f2a7 tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-62c01295-fba3-4b28-a538-8f7bfc5ff7a0-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:37 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135" returned: 0 in 0.543s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.846s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1897912912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e56f91-503d-41aa-9c13-26b727f9e94e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7538b079b44f6a811f67a19ef62c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:31Z,use_quota=True,user_id='04492d678a554fdd93bd002ae8792297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Creating volume 28e56f91-503d-41aa-9c13-26b727f9e94e {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:37 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-28e56f91-503d-41aa-9c13-26b727f9e94e 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8c957d-5881-44f4-bfc8-cf470a4b2453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f297527-a06f-4a0c-90fb-69f268d8994a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:37 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-28e56f91-503d-41aa-9c13-26b727f9e94e 1073741824 Apr 21 02:12:37 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:37 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Volume volume-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135 (fc413f84-b22e-4d3d-a7cf-c2de4c2a4135): created successfully Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f297527-a06f-4a0c-90fb-69f268d8994a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Flow 'volume_create_manager' (25c6d7b6-7180-45aa-b768-35ee199f86f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:37 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-11ccbe27-48c6-4e7b-b23e-07f4517070e2 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Created volume successfully. Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "cinder-67de9289-067b-4868-a20e-948538ef1703-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-67de9289-067b-4868-a20e-948538ef1703-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "cinder-quobyte-67de9289-067b-4868-a20e-948538ef1703" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-quobyte-67de9289-067b-4868-a20e-948538ef1703" acquired by "delete_volume" :: waited 0.019s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e7c9bd-dec1-4390-8bab-60a9c81c37f7]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-67de9289-067b-4868-a20e-948538ef1703 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Flow 'volume_create_manager' (44c34c61-759e-43e2-939d-5edbdb24f6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db97eeb3-c3a3-4049-a1c7-530cfb4f9827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:37 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db97eeb3-c3a3-4049-a1c7-530cfb4f9827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1603688713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4ff573-14e9-49ba-ad28-e45232369ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ab1da15bfb43dc992051fe3b766163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=da09e09c-2320-4244-b86d-714efd40623f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:38Z,use_quota=True,user_id='adb8ec535ec2419fa0e1444021c2c7b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b0e564-a7a8-4e7b-98be-865e48200a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b0e564-a7a8-4e7b-98be-865e48200a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3091d496-ac8f-43ce-a208-949754e17f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3091d496-ac8f-43ce-a208-949754e17f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4d4ff573-14e9-49ba-ad28-e45232369ed8', 'volume_name': 'volume-4d4ff573-14e9-49ba-ad28-e45232369ed8', 'volume_size': 1, 'snapshot_id': 'da09e09c-2320-4244-b86d-714efd40623f'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53822687-23e4-4801-9810-b33e385ff897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53822687-23e4-4801-9810-b33e385ff897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8406f56a-ccb1-4a82-b624-8eee0dc73275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:38 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Volume 4d4ff573-14e9-49ba-ad28-e45232369ed8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4d4ff573-14e9-49ba-ad28-e45232369ed8', 'volume_size': 1, 'snapshot_id': 'da09e09c-2320-4244-b86d-714efd40623f'} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:38 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-67de9289-067b-4868-a20e-948538ef1703 Apr 21 02:12:38 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:38 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-28e56f91-503d-41aa-9c13-26b727f9e94e 1073741824" returned: 0 in 0.611s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-28e56f91-503d-41aa-9c13-26b727f9e94e {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:38 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-28e56f91-503d-41aa-9c13-26b727f9e94e Apr 21 02:12:38 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:38 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-67de9289-067b-4868-a20e-948538ef1703" returned: 0 in 0.623s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-67de9289-067b-4868-a20e-948538ef1703 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:38 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-67de9289-067b-4868-a20e-948538ef1703 Apr 21 02:12:38 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG oslo_service.periodic_task [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:38 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-28e56f91-503d-41aa-9c13-26b727f9e94e" returned: 0 in 0.468s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:38 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:38 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.638s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-431439843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab32012-2693-4d5f-951e-47f45a0c5f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7538b079b44f6a811f67a19ef62c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:31Z,use_quota=True,user_id='04492d678a554fdd93bd002ae8792297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Creating volume 9ab32012-2693-4d5f-951e-47f45a0c5f95 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:38 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9ab32012-2693-4d5f-951e-47f45a0c5f95 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:38 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9ab32012-2693-4d5f-951e-47f45a0c5f95 1073741824 Apr 21 02:12:38 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc31a11b-c46a-448c-a1fe-73461e1c3ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28e56f91-503d-41aa-9c13-26b727f9e94e', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5798da-b9a6-4473-85c4-3690b50ceb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:38 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Volume volume-28e56f91-503d-41aa-9c13-26b727f9e94e (28e56f91-503d-41aa-9c13-26b727f9e94e): created successfully Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5798da-b9a6-4473-85c4-3690b50ceb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:38 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Flow 'volume_create_manager' (3f33b647-fcae-45db-9987-a6e0cfba90ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:38 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-fa412b61-8182-4c86-904d-79ead29245cf tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Created volume successfully. Apr 21 02:12:39 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-67de9289-067b-4868-a20e-948538ef1703" returned: 0 in 0.480s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-quobyte-67de9289-067b-4868-a20e-948538ef1703" released by "delete_volume" :: held 1.129s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] Created reservations ['dd8811d4-4dbf-4e17-bcae-07e10c99ba48', '008272a5-a4f0-4155-9d7a-e9531cc32b6b', 'aff81721-ac1d-4d13-8cf1-ff8fd151ff1f', '4ab34f05-af50-4fbd-8019-7e4b5d1ab259'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:39 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:39 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:39 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.698s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-ae18b09e-dabd-4888-95af-1e502a31ce13 None None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:39 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9ab32012-2693-4d5f-951e-47f45a0c5f95 1073741824" returned: 0 in 0.665s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9ab32012-2693-4d5f-951e-47f45a0c5f95 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:39 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9ab32012-2693-4d5f-951e-47f45a0c5f95 Apr 21 02:12:39 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:39 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.472s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:39 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] Deleted volume successfully. Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3cd15227-69d1-4d3d-9e79-556009f39586 tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-67de9289-067b-4868-a20e-948538ef1703-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:39 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9ab32012-2693-4d5f-951e-47f45a0c5f95" returned: 0 in 0.471s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.556s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-922363450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469b1def-207f-43f6-ad39-2fdadcc38893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7538b079b44f6a811f67a19ef62c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:31Z,use_quota=True,user_id='04492d678a554fdd93bd002ae8792297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Creating volume 469b1def-207f-43f6-ad39-2fdadcc38893 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:39 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:12:39 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-469b1def-207f-43f6-ad39-2fdadcc38893 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:40 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-469b1def-207f-43f6-ad39-2fdadcc38893 1073741824 Apr 21 02:12:40 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:40 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7068c7-85e2-4f01-961e-3d0bf367c4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ab32012-2693-4d5f-951e-47f45a0c5f95', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:40 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a3b67d7-93e4-4b44-b454-09ac0604a5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:40 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Volume volume-9ab32012-2693-4d5f-951e-47f45a0c5f95 (9ab32012-2693-4d5f-951e-47f45a0c5f95): created successfully Apr 21 02:12:40 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a3b67d7-93e4-4b44-b454-09ac0604a5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:40 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Flow 'volume_create_manager' (522e932f-1f20-4ffa-a004-ffbe6fb56222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:40 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-aa2467c2-bb1a-4102-9932-4f2e7ee6d08e tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Created volume successfully. Apr 21 02:12:40 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "cinder-4d927068-f5ab-4da1-a4cd-262d0176bed3-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:40 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-4d927068-f5ab-4da1-a4cd-262d0176bed3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:40 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "cinder-quobyte-4d927068-f5ab-4da1-a4cd-262d0176bed3" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:40 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-quobyte-4d927068-f5ab-4da1-a4cd-262d0176bed3" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:40 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5bb86d-0b19-4635-a8cd-624e25e24d4a]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d927068-f5ab-4da1-a4cd-262d0176bed3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:40 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d927068-f5ab-4da1-a4cd-262d0176bed3 Apr 21 02:12:40 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:40 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-469b1def-207f-43f6-ad39-2fdadcc38893 1073741824" returned: 0 in 0.544s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-469b1def-207f-43f6-ad39-2fdadcc38893 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:40 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-469b1def-207f-43f6-ad39-2fdadcc38893 Apr 21 02:12:40 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:40 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d927068-f5ab-4da1-a4cd-262d0176bed3" returned: 0 in 0.585s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:40 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d927068-f5ab-4da1-a4cd-262d0176bed3 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:40 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d927068-f5ab-4da1-a4cd-262d0176bed3 Apr 21 02:12:40 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:41 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-469b1def-207f-43f6-ad39-2fdadcc38893" returned: 0 in 0.506s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.482s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-434080290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f73c43e9-dffd-427d-be10-ab94cd0b443e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7538b079b44f6a811f67a19ef62c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:32Z,use_quota=True,user_id='04492d678a554fdd93bd002ae8792297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Creating volume f73c43e9-dffd-427d-be10-ab94cd0b443e {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:41 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f73c43e9-dffd-427d-be10-ab94cd0b443e 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b4a643-2fe4-4fd3-80c3-997ab1fafae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-469b1def-207f-43f6-ad39-2fdadcc38893', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:41 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f73c43e9-dffd-427d-be10-ab94cd0b443e 1073741824 Apr 21 02:12:41 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f9581e-9a2e-48c0-a5cf-766952a23801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:41 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Volume volume-469b1def-207f-43f6-ad39-2fdadcc38893 (469b1def-207f-43f6-ad39-2fdadcc38893): created successfully Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f9581e-9a2e-48c0-a5cf-766952a23801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Flow 'volume_create_manager' (7555c1ad-dd16-4a09-bce6-3eb34e464b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:41 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-9416d4c2-05e8-4e7d-813e-ae10557ba120 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Created volume successfully. Apr 21 02:12:41 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d927068-f5ab-4da1-a4cd-262d0176bed3" returned: 0 in 0.529s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-quobyte-4d927068-f5ab-4da1-a4cd-262d0176bed3" released by "delete_volume" :: held 1.139s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] Created reservations ['e16c69df-f267-4de8-9b20-46b0370542bd', 'acb70fb9-fe5d-4085-96e6-50f44e4e6774', 'effdf7cc-6c79-44cd-ae28-46e7a149e84f', 'fe292318-6f57-4ff3-9ae4-da675105769a'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:41 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:41 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:41 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f73c43e9-dffd-427d-be10-ab94cd0b443e 1073741824" returned: 0 in 0.517s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f73c43e9-dffd-427d-be10-ab94cd0b443e {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:41 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f73c43e9-dffd-427d-be10-ab94cd0b443e Apr 21 02:12:41 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Flow 'volume_create_manager' (a391c78b-9815-4aa6-a9ba-5adfec6685dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6c2c93-3154-4061-8fbb-bb9403871492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6c2c93-3154-4061-8fbb-bb9403871492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1064324253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f078cb-47dd-4da4-8123-208967f19bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='269009f144d64f68aaac66598fb8ac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:42Z,use_quota=True,user_id='2bd4341b642345308b0de845247add71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeefb906-21a9-4393-a8c2-0c451a354c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeefb906-21a9-4393-a8c2-0c451a354c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33527d76-6b8a-4284-b45f-ece748fbdf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33527d76-6b8a-4284-b45f-ece748fbdf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43f078cb-47dd-4da4-8123-208967f19bf6', 'volume_name': 'volume-43f078cb-47dd-4da4-8123-208967f19bf6', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6180f2-aa05-4a32-a1fa-d6fbf0a100e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6180f2-aa05-4a32-a1fa-d6fbf0a100e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b9d225-2adb-4d14-893d-7b27f65fd0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:41 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Volume 43f078cb-47dd-4da4-8123-208967f19bf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43f078cb-47dd-4da4-8123-208967f19bf6', 'volume_size': 1} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:41 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.420s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:41 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] Deleted volume successfully. Apr 21 02:12:41 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-24f5d21d-75b9-41e4-a0f9-43b72e8f1491 tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-4d927068-f5ab-4da1-a4cd-262d0176bed3-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:42 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f73c43e9-dffd-427d-be10-ab94cd0b443e" returned: 0 in 0.422s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.052s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Acquiring lock "cinder-quobyte-da09e09c-2320-4244-b86d-714efd40623f-4d4ff573-14e9-49ba-ad28-e45232369ed8" by "_create_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f18ea1-d354-4545-9b38-a4a21da135c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f73c43e9-dffd-427d-be10-ab94cd0b443e', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b24d3f88-5ebd-4baa-add1-3c7e0edb7855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:42 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Volume volume-f73c43e9-dffd-427d-be10-ab94cd0b443e (f73c43e9-dffd-427d-be10-ab94cd0b443e): created successfully Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b24d3f88-5ebd-4baa-add1-3c7e0edb7855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Flow 'volume_create_manager' (111d6c63-6a0d-4532-9070-4bfa6d64d14c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-da09e09c-2320-4244-b86d-714efd40623f-4d4ff573-14e9-49ba-ad28-e45232369ed8" acquired by "_create_volume_from_snapshot" :: waited 0.072s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Creating volume 4d4ff573-14e9-49ba-ad28-e45232369ed8 from snapshot da09e09c-2320-4244-b86d-714efd40623f {{(pid=82184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Acquiring lock "cinder-quobyte-4d4ff573-14e9-49ba-ad28-e45232369ed8" by "_copy_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:42 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-ffcbfe15-2185-465d-94b9-17a36f371021 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Created volume successfully. Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-4d4ff573-14e9-49ba-ad28-e45232369ed8" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] snapshot: da09e09c-2320-4244-b86d-714efd40623f, volume: 4d4ff573-14e9-49ba-ad28-e45232369ed8, {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c139362-fe66-4253-82a9-4ff866734712]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:42 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f Apr 21 02:12:42 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "cinder-cd199d97-6ae5-40e2-a86f-7d9605fa4b38-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-cd199d97-6ae5-40e2-a86f-7d9605fa4b38-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "cinder-quobyte-cd199d97-6ae5-40e2-a86f-7d9605fa4b38" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-quobyte-cd199d97-6ae5-40e2-a86f-7d9605fa4b38" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ad1257-65fe-4a9a-8bf4-91d7a38b8108]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd199d97-6ae5-40e2-a86f-7d9605fa4b38 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:42 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd199d97-6ae5-40e2-a86f-7d9605fa4b38 Apr 21 02:12:42 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "cinder-f73c43e9-dffd-427d-be10-ab94cd0b443e-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-f73c43e9-dffd-427d-be10-ab94cd0b443e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "cinder-quobyte-f73c43e9-dffd-427d-be10-ab94cd0b443e" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-quobyte-f73c43e9-dffd-427d-be10-ab94cd0b443e" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f0d357-afa9-4808-9b6b-087fe34483b0]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f73c43e9-dffd-427d-be10-ab94cd0b443e {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:42 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f73c43e9-dffd-427d-be10-ab94cd0b443e Apr 21 02:12:42 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:42 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f" returned: 0 in 0.479s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Creating direct copy from snapshot {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b016af-bf92-48d1-bb46-b47c91d8ef10]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:42 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c Apr 21 02:12:42 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:42 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd199d97-6ae5-40e2-a86f-7d9605fa4b38" returned: 0 in 0.519s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:42 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd199d97-6ae5-40e2-a86f-7d9605fa4b38 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:42 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd199d97-6ae5-40e2-a86f-7d9605fa4b38 Apr 21 02:12:42 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:43 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f73c43e9-dffd-427d-be10-ab94cd0b443e" returned: 0 in 0.494s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f73c43e9-dffd-427d-be10-ab94cd0b443e {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:43 devstack sudo[90275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f73c43e9-dffd-427d-be10-ab94cd0b443e Apr 21 02:12:43 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:43 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c" returned: 0 in 0.514s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG cinder.utils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Path /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d4ff573-14e9-49ba-ad28-e45232369ed8 not found in is_blk_device check {{(pid=82184) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d4ff573-14e9-49ba-ad28-e45232369ed8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:43 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d4ff573-14e9-49ba-ad28-e45232369ed8 Apr 21 02:12:43 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:43 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-cd199d97-6ae5-40e2-a86f-7d9605fa4b38" returned: 0 in 0.408s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-quobyte-cd199d97-6ae5-40e2-a86f-7d9605fa4b38" released by "delete_volume" :: held 0.949s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] Created reservations ['9c34bd6f-e463-4162-9d97-43ba25cf6395', 'd49850b4-e9ab-4e41-863c-ba90b28e37bf', '202aae3d-f70c-4f8e-abed-ff4404f94441', 'd79f5a12-5bc6-4ff1-9bf1-e124ec908590'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:43 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:43 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:43 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-f73c43e9-dffd-427d-be10-ab94cd0b443e" returned: 0 in 0.440s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-quobyte-f73c43e9-dffd-427d-be10-ab94cd0b443e" released by "delete_volume" :: held 0.956s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Created reservations ['1bfd3e8a-946a-40f8-9647-9ea432cd1b17', '9ddd2d37-d760-4c1c-9b54-5903dc970ee8', '1ab85e48-3eeb-4909-9ddf-0fac068e00ed', '5f951e38-39de-447a-b759-1fc9dbb542e2'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:43 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:43 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:43 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:44 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.846s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:44 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:44 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 1.082s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:44 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:44 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] Deleted volume successfully. Apr 21 02:12:44 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Deleted volume successfully. Apr 21 02:12:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fd4f6c6b-66b6-435a-a233-f72333445b9e tempest-CreateVolumesFromImageTest-368972753 None] Lock "cinder-cd199d97-6ae5-40e2-a86f-7d9605fa4b38-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2380026c-9542-41bc-a9b4-1d38d3a9db54 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-f73c43e9-dffd-427d-be10-ab94cd0b443e-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "cinder-469b1def-207f-43f6-ad39-2fdadcc38893-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-469b1def-207f-43f6-ad39-2fdadcc38893-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "cinder-quobyte-469b1def-207f-43f6-ad39-2fdadcc38893" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:44 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-quobyte-469b1def-207f-43f6-ad39-2fdadcc38893" acquired by "delete_volume" :: waited 0.024s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:44 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7d7c39-e3f2-4828-aa0b-6775a23a5c2b]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:44 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-469b1def-207f-43f6-ad39-2fdadcc38893 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:45 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-469b1def-207f-43f6-ad39-2fdadcc38893 Apr 21 02:12:45 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:45 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d4ff573-14e9-49ba-ad28-e45232369ed8" returned: 0 in 2.439s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:45 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f990e80-c03e-4c25-8ac0-f41ac2767feb]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:45 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c Apr 21 02:12:45 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:45 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-469b1def-207f-43f6-ad39-2fdadcc38893" returned: 0 in 1.017s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:45 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-469b1def-207f-43f6-ad39-2fdadcc38893 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:45 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-469b1def-207f-43f6-ad39-2fdadcc38893 Apr 21 02:12:45 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:46 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:46 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-469b1def-207f-43f6-ad39-2fdadcc38893" returned: 0 in 0.462s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c" returned: 0 in 0.672s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Image conversion details: src /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c, size 1024.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d4ff573-14e9-49ba-ad28-e45232369ed8 {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:12:46 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Converted 1024.00 MB image at 419.54 MB/s Apr 21 02:12:46 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d4ff573-14e9-49ba-ad28-e45232369ed8 is being set with open permissions: ugo+rw Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d4ff573-14e9-49ba-ad28-e45232369ed8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-quobyte-469b1def-207f-43f6-ad39-2fdadcc38893" released by "delete_volume" :: held 1.540s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:46 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d4ff573-14e9-49ba-ad28-e45232369ed8 Apr 21 02:12:46 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Created reservations ['294fcc5e-a75c-496e-be7e-bdfe74d4e716', 'f279ed15-0891-44c7-baeb-5795eff1ffc5', 'f5772782-b40e-4844-bc40-468fe1cc95ed', 'f72f2d3f-0e35-4243-b118-b56e5284c86c'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:46 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:46 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Flow 'volume_create_manager' (9bc8cb11-63e6-4cf3-980c-9fc838f5fd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7094305b-675f-4c91-ad9e-207058bb11c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7094305b-675f-4c91-ad9e-207058bb11c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-263033267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c420a28f-9bbb-4651-b4bd-11047994d4d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dea4b736e24750bfe37f0b45aa4b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:46Z,use_quota=True,user_id='df4587d2ba354cfd9e0043b8f6d524ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad4c87d-170f-4497-8be9-61d56602d199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad4c87d-170f-4497-8be9-61d56602d199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11fde6d1-4a53-4fcf-9ca1-a2a96d84ddda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11fde6d1-4a53-4fcf-9ca1-a2a96d84ddda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c420a28f-9bbb-4651-b4bd-11047994d4d6', 'volume_name': 'volume-c420a28f-9bbb-4651-b4bd-11047994d4d6', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41317cbd-231d-4386-b9c0-31f3413a119b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41317cbd-231d-4386-b9c0-31f3413a119b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (535dc15c-a6f8-4c46-992f-3f9946ef4d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:46 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Volume c420a28f-9bbb-4651-b4bd-11047994d4d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c420a28f-9bbb-4651-b4bd-11047994d4d6', 'volume_size': 1} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:46 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d4ff573-14e9-49ba-ad28-e45232369ed8" returned: 0 in 0.503s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-4d4ff573-14e9-49ba-ad28-e45232369ed8" released by "_copy_volume_from_snapshot" :: held 4.664s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-da09e09c-2320-4244-b86d-714efd40623f-4d4ff573-14e9-49ba-ad28-e45232369ed8" released by "_create_volume_from_snapshot" :: held 4.682s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.755s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.051s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1064324253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f078cb-47dd-4da4-8123-208967f19bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='269009f144d64f68aaac66598fb8ac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:42Z,use_quota=True,user_id='2bd4341b642345308b0de845247add71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Creating volume 43f078cb-47dd-4da4-8123-208967f19bf6 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:46 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:46 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 1073741824 Apr 21 02:12:46 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8406f56a-ccb1-4a82-b624-8eee0dc73275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4ff573-14e9-49ba-ad28-e45232369ed8', 'volume_size': 1, 'snapshot_id': 'da09e09c-2320-4244-b86d-714efd40623f'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9a5003-c1a0-4216-a00c-682fa14745a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:46 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Volume volume-4d4ff573-14e9-49ba-ad28-e45232369ed8 (4d4ff573-14e9-49ba-ad28-e45232369ed8): created successfully Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9a5003-c1a0-4216-a00c-682fa14745a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Flow 'volume_create_manager' (44c34c61-759e-43e2-939d-5edbdb24f6f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "cinder-9ab32012-2693-4d5f-951e-47f45a0c5f95-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:46 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.482s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:46 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Deleted volume successfully. Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-9ab32012-2693-4d5f-951e-47f45a0c5f95-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:46 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-eed0c345-1812-4947-9790-bef5976d1006 tempest-VolumeDependencyTests-952227776 None] Created volume successfully. Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-40fa7b81-0bd9-440e-945b-6ca765d9170b tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-469b1def-207f-43f6-ad39-2fdadcc38893-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:46 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "cinder-quobyte-9ab32012-2693-4d5f-951e-47f45a0c5f95" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-quobyte-9ab32012-2693-4d5f-951e-47f45a0c5f95" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[849ae9cb-d1f8-4e15-8d4d-04f7bc0d5b56]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9ab32012-2693-4d5f-951e-47f45a0c5f95 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:47 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9ab32012-2693-4d5f-951e-47f45a0c5f95 Apr 21 02:12:47 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:47 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 1073741824" returned: 0 in 0.497s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:47 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 Apr 21 02:12:47 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:47 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9ab32012-2693-4d5f-951e-47f45a0c5f95" returned: 0 in 0.488s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9ab32012-2693-4d5f-951e-47f45a0c5f95 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:47 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9ab32012-2693-4d5f-951e-47f45a0c5f95 Apr 21 02:12:47 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] Acquiring lock "cinder-da09e09c-2320-4244-b86d-714efd40623f-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] Lock "cinder-da09e09c-2320-4244-b86d-714efd40623f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] Acquiring lock "cinder-quobyte-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c" acquired by "delete_snapshot" :: waited 0.005s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] Acquiring lock "cinder-quobyte-da09e09c-2320-4244-b86d-714efd40623f" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-da09e09c-2320-4244-b86d-714efd40623f" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] Deleting offline snapshot da09e09c-2320-4244-b86d-714efd40623f of volume 0d65a88f-2ff9-4ee5-807a-e1b70b58d65c {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] snapshot_file for this snap is: volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e7b6c7-73c4-49c0-aa4c-72f6c4320e03]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:47 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f Apr 21 02:12:47 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:47 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6" returned: 0 in 0.433s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.245s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-263033267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c420a28f-9bbb-4651-b4bd-11047994d4d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dea4b736e24750bfe37f0b45aa4b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:46Z,use_quota=True,user_id='df4587d2ba354cfd9e0043b8f6d524ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Creating volume c420a28f-9bbb-4651-b4bd-11047994d4d6 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:47 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b9d225-2adb-4d14-893d-7b27f65fd0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43f078cb-47dd-4da4-8123-208967f19bf6', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fdbe4c-24bd-44fc-aa58-1e4c4abebef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:47 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6 1073741824 Apr 21 02:12:47 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:47 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Volume volume-43f078cb-47dd-4da4-8123-208967f19bf6 (43f078cb-47dd-4da4-8123-208967f19bf6): created successfully Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fdbe4c-24bd-44fc-aa58-1e4c4abebef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Flow 'volume_create_manager' (a391c78b-9815-4aa6-a9ba-5adfec6685dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:47 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-dfb98f15-273b-4a9c-bd5d-dbef6660055a tempest-SnapshotDependencyTests-888735543 None] Created volume successfully. Apr 21 02:12:47 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-9ab32012-2693-4d5f-951e-47f45a0c5f95" returned: 0 in 0.441s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-quobyte-9ab32012-2693-4d5f-951e-47f45a0c5f95" released by "delete_volume" :: held 0.949s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:47 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Created reservations ['0eff5934-ea55-4304-bdf2-5af62edf7a97', 'e6b059cc-b19b-4ca1-b5aa-8fc6948b135a', 'aa07987c-bc4a-4d4b-91d6-115dcc816f4f', 'aade7f3a-1311-4be2-b428-dc9cbd4cc369'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:48 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:48 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:48 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f" returned: 0 in 0.500s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3b85b7-b91e-47a8-a03d-62a74126b89a]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:48 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c Apr 21 02:12:48 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:48 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6 1073741824" returned: 0 in 0.533s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:48 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6 Apr 21 02:12:48 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:48 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.436s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:48 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Deleted volume successfully. Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0b00073e-ec92-4b56-b9a6-284ea46318ed tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-9ab32012-2693-4d5f-951e-47f45a0c5f95-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:48 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c" returned: 0 in 0.519s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:48 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f Apr 21 02:12:48 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:48 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6" returned: 0 in 0.438s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.453s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (535dc15c-a6f8-4c46-992f-3f9946ef4d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c420a28f-9bbb-4651-b4bd-11047994d4d6', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7baca89-89ce-4d00-8b7f-7af07a78b57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:48 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Volume volume-c420a28f-9bbb-4651-b4bd-11047994d4d6 (c420a28f-9bbb-4651-b4bd-11047994d4d6): created successfully Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7baca89-89ce-4d00-8b7f-7af07a78b57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Flow 'volume_create_manager' (9bc8cb11-63e6-4cf3-980c-9fc838f5fd38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] Creating offline snapshot ee155fa4-8ae6-44f4-ae11-f58859062183 of volume 43f078cb-47dd-4da4-8123-208967f19bf6 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:12:48 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-bb9a679b-8f22-4f7e-a317-023a09bc2496 tempest-CreateVolumesFromSnapshotTest-767066590 None] Created volume successfully. Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3e1480-5d76-474b-a758-e7f1dbd8eabc]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:48 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:48 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 Apr 21 02:12:48 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "cinder-28e56f91-503d-41aa-9c13-26b727f9e94e-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-28e56f91-503d-41aa-9c13-26b727f9e94e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:49 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f" returned: 0 in 0.493s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "cinder-quobyte-28e56f91-503d-41aa-9c13-26b727f9e94e" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:49 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f Apr 21 02:12:49 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-quobyte-28e56f91-503d-41aa-9c13-26b727f9e94e" acquired by "delete_volume" :: waited 0.029s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[01de5a99-0a45-42c0-a082-6a2c7f2ca7b9]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-28e56f91-503d-41aa-9c13-26b727f9e94e {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:49 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-28e56f91-503d-41aa-9c13-26b727f9e94e Apr 21 02:12:49 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:49 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6" returned: 0 in 0.501s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:49 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183 1G Apr 21 02:12:49 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:49 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c.da09e09c-2320-4244-b86d-714efd40623f" returned: 0 in 0.423s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-da09e09c-2320-4244-b86d-714efd40623f" released by "_delete_snapshot" :: held 1.990s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c" released by "delete_snapshot" :: held 2.006s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] Created reservations ['d79440d1-dc0e-4ddd-9052-97326bdc130d', 'b9263598-140a-4157-88cc-eb70285d346e', '8ab8ecb4-8d2e-4639-a942-20cb563a7f05', '43c9bf70-5098-4d18-a227-c73bd55f4c20'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:49 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] Delete snapshot completed successfully. Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-305547f9-478b-49d1-b62a-86f60e414f6c tempest-VolumeDependencyTests-952227776 None] Lock "cinder-da09e09c-2320-4244-b86d-714efd40623f-delete_snapshot" released by "delete_snapshot" :: held 2.102s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:49 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-28e56f91-503d-41aa-9c13-26b727f9e94e" returned: 0 in 0.535s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-28e56f91-503d-41aa-9c13-26b727f9e94e {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:49 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-28e56f91-503d-41aa-9c13-26b727f9e94e Apr 21 02:12:49 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:49 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183 1G" returned: 0 in 0.512s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:49 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f078cb-47dd-4da4-8123-208967f19bf6 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:49 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f078cb-47dd-4da4-8123-208967f19bf6 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183 Apr 21 02:12:49 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:50 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-28e56f91-503d-41aa-9c13-26b727f9e94e" returned: 0 in 0.444s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-quobyte-28e56f91-503d-41aa-9c13-26b727f9e94e" released by "delete_volume" :: held 1.001s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Created reservations ['b3e98a2f-35fc-4fb3-990f-7faf155ce160', 'c3018026-ec55-4a5c-89e6-a031c1dbb051', 'e1155a8d-75d7-4567-bcb5-1e8322aadfd2', '2a9a5b38-5fde-4b26-bdc0-8be56bdae5fc'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:50 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:50 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:50 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f078cb-47dd-4da4-8123-208967f19bf6 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183" returned: 0 in 0.434s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:50 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183 is being set with open permissions: ugo+rw Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:50 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183 Apr 21 02:12:50 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:50 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.424s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:50 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Deleted volume successfully. Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-c4a0563e-7064-4309-8a88-d1826ff2e6da tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-28e56f91-503d-41aa-9c13-26b727f9e94e-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] Acquiring lock "cinder-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:50 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183" returned: 0 in 0.426s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] Lock "cinder-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:50 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.info Apr 21 02:12:50 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] Acquiring lock "cinder-quobyte-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[011ea311-4347-4738-9074-90c72cf750b9]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:50 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:50 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c Apr 21 02:12:50 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:51 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.info" returned: 0 in 0.419s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:51 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.info is being set with open permissions: ugo+rw Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:51 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.info Apr 21 02:12:51 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:51 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c" returned: 0 in 0.460s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:51 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c Apr 21 02:12:51 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "cinder-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "cinder-quobyte-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-quobyte-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[667872a1-c65e-47da-8589-bf14716e4f27]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:51 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135 Apr 21 02:12:51 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:51 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.info" returned: 0 in 0.442s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.826s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.833s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] Creating offline snapshot d6fc620b-a3c9-41f0-825a-16cd3d1c1b49 of volume c420a28f-9bbb-4651-b4bd-11047994d4d6 {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:12:51 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-1f8eb22e-a673-43c1-9f7d-20f39a3bedb3 tempest-SnapshotDependencyTests-888735543 None] Create snapshot completed successfully Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[354c4a7f-346b-47ff-b917-cd968f3fb130]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:51 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c" returned: 0 in 0.413s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c" released by "delete_volume" :: held 0.902s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] Created reservations ['ef2ec09f-0132-465a-ac96-8b3633926779', '6e9ada5e-b28a-4969-89b3-c26284f79d29', '44a0dbb1-465a-4818-b563-f293cce04d2d', '212e5317-c7c7-49b2-b3b0-a1c152e2bf3f'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:51 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6 Apr 21 02:12:51 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:51 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:51 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:51 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135" returned: 0 in 0.510s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:51 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:51 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135 Apr 21 02:12:51 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Flow 'volume_create_manager' (55137dd2-5f61-4b19-8126-e14acd0368ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624af5c9-acb5-4068-8dde-78cf5a9d08c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624af5c9-acb5-4068-8dde-78cf5a9d08c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1648471736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b564344c-4a26-4bc1-bd19-ddae4fb0acfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ab1da15bfb43dc992051fe3b766163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:52Z,use_quota=True,user_id='adb8ec535ec2419fa0e1444021c2c7b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27c3855-ac46-48da-bcb0-c3666d01b7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27c3855-ac46-48da-bcb0-c3666d01b7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a14e653-39e6-4f28-983e-2ca8b7658086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a14e653-39e6-4f28-983e-2ca8b7658086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b564344c-4a26-4bc1-bd19-ddae4fb0acfa', 'volume_name': 'volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f242095-2d72-4265-a2e6-415ffd11cf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f242095-2d72-4265-a2e6-415ffd11cf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55587a3f-581f-4725-a6cf-fa703c92a257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:52 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Volume b564344c-4a26-4bc1-bd19-ddae4fb0acfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa', 'volume_size': 1} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:52 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6" returned: 0 in 0.584s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:52 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.484s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:52 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49 1G Apr 21 02:12:52 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:52 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] Deleted volume successfully. Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ff5f6979-769d-4884-8d31-bad55983507a tempest-VolumeDependencyTests-952227776 None] Lock "cinder-0d65a88f-2ff9-4ee5-807a-e1b70b58d65c-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:52 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135" returned: 0 in 0.487s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-quobyte-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135" released by "delete_volume" :: held 1.024s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Created reservations ['4a28fc5b-312c-4884-b08f-8d5bf837b01e', '5f4422f7-88cd-4438-8025-11f1f7acd191', '4bd97555-0456-4a08-8fad-1ab872a79ebf', '53c7e23d-e687-4867-9590-034a20f477b8'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:52 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:52 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Flow 'volume_create_manager' (98d43f46-2f74-4706-82f5-10ae013bd45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c2a31f-a33e-4c00-8fbd-fda4304c5322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c2a31f-a33e-4c00-8fbd-fda4304c5322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786d4c98-ab92-425b-8b74-9d84306eda06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='269009f144d64f68aaac66598fb8ac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ee155fa4-8ae6-44f4-ae11-f58859062183,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:53Z,use_quota=True,user_id='2bd4341b642345308b0de845247add71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febb1670-5866-4fa4-8de7-ac6e39c6a9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febb1670-5866-4fa4-8de7-ac6e39c6a9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75a66e3-c838-49df-a6df-8253b5f452d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75a66e3-c838-49df-a6df-8253b5f452d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '786d4c98-ab92-425b-8b74-9d84306eda06', 'volume_name': 'volume-786d4c98-ab92-425b-8b74-9d84306eda06', 'volume_size': 1, 'snapshot_id': 'ee155fa4-8ae6-44f4-ae11-f58859062183'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9a326a-d085-48fe-938e-c06b51195702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9a326a-d085-48fe-938e-c06b51195702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc54fa9d-026f-4e1e-91b5-b1f14d36cffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:52 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Volume 786d4c98-ab92-425b-8b74-9d84306eda06: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-786d4c98-ab92-425b-8b74-9d84306eda06', 'volume_size': 1, 'snapshot_id': 'ee155fa4-8ae6-44f4-ae11-f58859062183'} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:52 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49 1G" returned: 0 in 0.615s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c420a28f-9bbb-4651-b4bd-11047994d4d6 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:52 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c420a28f-9bbb-4651-b4bd-11047994d4d6 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49 Apr 21 02:12:52 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:52 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.462s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:52 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Deleted volume successfully. Apr 21 02:12:52 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0c2e2e87-932d-40b7-addb-b3e4a5fad9e7 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-fc413f84-b22e-4d3d-a7cf-c2de4c2a4135-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:53 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c420a28f-9bbb-4651-b4bd-11047994d4d6 -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49" returned: 0 in 0.420s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:53 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49 is being set with open permissions: ugo+rw Apr 21 02:12:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:53 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49 Apr 21 02:12:53 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:53 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "cinder-211cc2c3-2299-4887-be45-59995a42086b-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:53 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-211cc2c3-2299-4887-be45-59995a42086b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:53 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "cinder-quobyte-211cc2c3-2299-4887-be45-59995a42086b" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:53 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-quobyte-211cc2c3-2299-4887-be45-59995a42086b" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:53 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a1ea14-ad65-4377-a147-361f6e2dccc3]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-211cc2c3-2299-4887-be45-59995a42086b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:53 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-211cc2c3-2299-4887-be45-59995a42086b Apr 21 02:12:53 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:53 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49" returned: 0 in 0.430s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:53 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:53 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.info Apr 21 02:12:53 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:54 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-211cc2c3-2299-4887-be45-59995a42086b" returned: 0 in 0.470s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-211cc2c3-2299-4887-be45-59995a42086b {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:54 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-211cc2c3-2299-4887-be45-59995a42086b Apr 21 02:12:54 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:54 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.info" returned: 0 in 0.444s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:54 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.info is being set with open permissions: ugo+rw Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:54 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.info Apr 21 02:12:54 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:54 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-211cc2c3-2299-4887-be45-59995a42086b" returned: 0 in 0.408s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-quobyte-211cc2c3-2299-4887-be45-59995a42086b" released by "delete_volume" :: held 0.902s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Created reservations ['7020b76d-4f72-40d7-b48b-7fc5b7391f4a', 'e17d1559-98c6-4f31-974b-8cde9473e6f7', '45a88ba1-dfb3-4aa3-939f-0a814a5c253c', 'bdf60e6e-8ac1-4baf-8be7-13119e84ceb7'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:54 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:12:54 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:54 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.info" returned: 0 in 0.421s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.980s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.512s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1648471736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b564344c-4a26-4bc1-bd19-ddae4fb0acfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ab1da15bfb43dc992051fe3b766163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:52Z,use_quota=True,user_id='adb8ec535ec2419fa0e1444021c2c7b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Creating volume b564344c-4a26-4bc1-bd19-ddae4fb0acfa {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:54 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:54 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa 1073741824 Apr 21 02:12:54 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:54 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-52590f35-7a7f-426f-9b88-1cd48c4aec90 tempest-CreateVolumesFromSnapshotTest-767066590 None] Create snapshot completed successfully Apr 21 02:12:54 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.459s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:12:54 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Deleted volume successfully. Apr 21 02:12:54 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b8aeddff-4a2b-46d4-b101-fd1a1e8345f9 tempest-CreateVolumesFromSourceVolumeTest-286889851 None] Lock "cinder-211cc2c3-2299-4887-be45-59995a42086b-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:55 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa 1073741824" returned: 0 in 0.565s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:55 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa Apr 21 02:12:55 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Flow 'volume_create_manager' (7836519c-4cc3-4c5f-8f07-3c08d9a87ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9205b5ee-7344-4712-a286-4bcdfc5ec0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9205b5ee-7344-4712-a286-4bcdfc5ec0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1533239560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6278b88c-ef14-436e-89e9-3c33babb7c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dea4b736e24750bfe37f0b45aa4b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:55Z,use_quota=True,user_id='df4587d2ba354cfd9e0043b8f6d524ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ea3b83-193b-4136-bf1c-5f49486deb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ea3b83-193b-4136-bf1c-5f49486deb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982898e3-93e0-4bb0-957a-5cd551aa0edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982898e3-93e0-4bb0-957a-5cd551aa0edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6278b88c-ef14-436e-89e9-3c33babb7c3e', 'volume_name': 'volume-6278b88c-ef14-436e-89e9-3c33babb7c3e', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2186fe-f041-4a94-bf55-a95adf91f052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2186fe-f041-4a94-bf55-a95adf91f052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb3536b-ec95-44c7-ad56-a19f1dc33baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Volume 6278b88c-ef14-436e-89e9-3c33babb7c3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6278b88c-ef14-436e-89e9-3c33babb7c3e', 'volume_size': 1} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Flow 'volume_create_manager' (76307c18-5fc1-40be-8d69-c0a6fe158409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2372740-1ee0-4485-a4b8-ccb07f304c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2372740-1ee0-4485-a4b8-ccb07f304c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1580570836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df2b008-010f-41f9-b015-0c5e0682d1f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dea4b736e24750bfe37f0b45aa4b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:55Z,use_quota=True,user_id='df4587d2ba354cfd9e0043b8f6d524ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c840aab7-5270-49b4-8575-013cfedbfd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c840aab7-5270-49b4-8575-013cfedbfd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2714cd94-611a-4a8e-b1ec-34a601dfc2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2714cd94-611a-4a8e-b1ec-34a601dfc2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2df2b008-010f-41f9-b015-0c5e0682d1f9', 'volume_name': 'volume-2df2b008-010f-41f9-b015-0c5e0682d1f9', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83704a8a-d829-4d56-a936-20a68142539a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83704a8a-d829-4d56-a936-20a68142539a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a446be6b-db96-4b1b-ba01-4cae8cce4ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Volume 2df2b008-010f-41f9-b015-0c5e0682d1f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2df2b008-010f-41f9-b015-0c5e0682d1f9', 'volume_size': 1} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Flow 'volume_create_manager' (093a62dd-73bb-4b56-9b4d-40faac7143e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddb85c3-f212-41f6-a992-034201b6f0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddb85c3-f212-41f6-a992-034201b6f0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1151711530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97597cf9-900f-440c-bd9d-b80fa76f2dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dea4b736e24750bfe37f0b45aa4b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:56Z,use_quota=True,user_id='df4587d2ba354cfd9e0043b8f6d524ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a76fc7-b5ca-451f-b683-178bf2dcb994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a76fc7-b5ca-451f-b683-178bf2dcb994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c2d39f-65bd-4d5b-9bf5-c416a47afa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c2d39f-65bd-4d5b-9bf5-c416a47afa13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97597cf9-900f-440c-bd9d-b80fa76f2dbc', 'volume_name': 'volume-97597cf9-900f-440c-bd9d-b80fa76f2dbc', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ca9b1e-f234-4f2e-a470-ef361d8776b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ca9b1e-f234-4f2e-a470-ef361d8776b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc7a7ea-a372-4538-a225-76a7a68cfb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Volume 97597cf9-900f-440c-bd9d-b80fa76f2dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97597cf9-900f-440c-bd9d-b80fa76f2dbc', 'volume_size': 1} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:55 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa" returned: 0 in 0.509s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.884s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Acquiring lock "cinder-quobyte-ee155fa4-8ae6-44f4-ae11-f58859062183-786d4c98-ab92-425b-8b74-9d84306eda06" by "_create_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55587a3f-581f-4725-a6cf-fa703c92a257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d47f60-5af8-4122-abb5-a659d5fa76d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Lock "cinder-quobyte-ee155fa4-8ae6-44f4-ae11-f58859062183-786d4c98-ab92-425b-8b74-9d84306eda06" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Creating volume 786d4c98-ab92-425b-8b74-9d84306eda06 from snapshot ee155fa4-8ae6-44f4-ae11-f58859062183 {{(pid=82184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Acquiring lock "cinder-quobyte-786d4c98-ab92-425b-8b74-9d84306eda06" by "_copy_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:12:55 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Volume volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa (b564344c-4a26-4bc1-bd19-ddae4fb0acfa): created successfully Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d47f60-5af8-4122-abb5-a659d5fa76d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Flow 'volume_create_manager' (55137dd2-5f61-4b19-8126-e14acd0368ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:55 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-7a65edcc-fe44-402d-b3ec-429b27413eac tempest-VolumeDependencyTests-952227776 None] Created volume successfully. Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Lock "cinder-quobyte-786d4c98-ab92-425b-8b74-9d84306eda06" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] snapshot: ee155fa4-8ae6-44f4-ae11-f58859062183, volume: 786d4c98-ab92-425b-8b74-9d84306eda06, {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e16dc22-cba0-49f9-9ce0-59a1f8c848c7]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Flow 'volume_create_manager' (31248e54-ae29-4a36-9eff-db19bd0deb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a947ae6b-3a13-4971-a9df-28132c6a9ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a947ae6b-3a13-4971-a9df-28132c6a9ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1204268322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e746b9-dbaa-4c24-ad0d-718691509662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dea4b736e24750bfe37f0b45aa4b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:56Z,use_quota=True,user_id='df4587d2ba354cfd9e0043b8f6d524ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8fa057d-1952-407a-aa82-7315511f9a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8fa057d-1952-407a-aa82-7315511f9a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4561612b-6a53-400a-bcf6-2b35a5014033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4561612b-6a53-400a-bcf6-2b35a5014033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e746b9-dbaa-4c24-ad0d-718691509662', 'volume_name': 'volume-c5e746b9-dbaa-4c24-ad0d-718691509662', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb51981-ba2b-4405-acec-4e7e0bfc41f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183 Apr 21 02:12:55 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb51981-ba2b-4405-acec-4e7e0bfc41f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30f59d6-23d5-425b-8443-f3f61c799d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:55 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Volume c5e746b9-dbaa-4c24-ad0d-718691509662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e746b9-dbaa-4c24-ad0d-718691509662', 'volume_size': 1} Apr 21 02:12:55 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Flow 'volume_create_manager' (2de9c6ff-0815-4a41-ad71-0686efd5ee13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b1e02a-51b8-45b9-a1e6-9789abf0aa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b1e02a-51b8-45b9-a1e6-9789abf0aa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-975906103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d5d3ce-775e-4054-8f7c-bbbec1fb8413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dea4b736e24750bfe37f0b45aa4b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:56Z,use_quota=True,user_id='df4587d2ba354cfd9e0043b8f6d524ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c7ace3-ebb9-4e46-b4c7-5e76cd79a37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c7ace3-ebb9-4e46-b4c7-5e76cd79a37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22780b0a-113f-4f4a-af1c-8a33f6c0df3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22780b0a-113f-4f4a-af1c-8a33f6c0df3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29d5d3ce-775e-4054-8f7c-bbbec1fb8413', 'volume_name': 'volume-29d5d3ce-775e-4054-8f7c-bbbec1fb8413', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddef34eb-9a2a-4901-99cd-97d2c378e89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddef34eb-9a2a-4901-99cd-97d2c378e89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3519b77-33e9-4e44-be70-47521c72656b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:56 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Volume 29d5d3ce-775e-4054-8f7c-bbbec1fb8413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29d5d3ce-775e-4054-8f7c-bbbec1fb8413', 'volume_size': 1} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:56 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183" returned: 0 in 0.531s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f078cb-47dd-4da4-8123-208967f19bf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Creating direct copy from snapshot {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ee32a3-b279-43bd-bfa0-967a145e5e1d]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:56 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 Apr 21 02:12:56 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Flow 'volume_create_manager' (35c4d908-8ab0-4750-b2e9-089819a86799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432c1d40-af4b-40ff-90fd-5f888edaf13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432c1d40-af4b-40ff-90fd-5f888edaf13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54bf7e32-6dce-453a-8ee3-fb6a583da327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ac1bcee3dd64feb8bfff9ee56a55347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:56Z,use_quota=True,user_id='198dd0ffa77d4e9ebb5e2f4036b5580c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865b4266-dcf5-4774-83ad-3861a436ad46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865b4266-dcf5-4774-83ad-3861a436ad46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ebf62e-2750-46e5-ae85-046650e7e762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ebf62e-2750-46e5-ae85-046650e7e762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54bf7e32-6dce-453a-8ee3-fb6a583da327', 'volume_name': 'volume-54bf7e32-6dce-453a-8ee3-fb6a583da327', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (368dc167-dfae-4101-9832-0ed4d052b4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (368dc167-dfae-4101-9832-0ed4d052b4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2d1f15-4547-4c72-833c-6d53c8edb528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:56 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Volume 54bf7e32-6dce-453a-8ee3-fb6a583da327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54bf7e32-6dce-453a-8ee3-fb6a583da327', 'volume_size': 1} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Flow 'volume_create_manager' (f439aa83-7298-4809-aad5-b267244d0979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7a347b-7aeb-4334-849b-a20908c4980b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7a347b-7aeb-4334-849b-a20908c4980b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-179833599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d45f3fe-2dd0-445c-a3c4-9efeadad2c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ab1da15bfb43dc992051fe3b766163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b564344c-4a26-4bc1-bd19-ddae4fb0acfa,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:57Z,use_quota=True,user_id='adb8ec535ec2419fa0e1444021c2c7b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2266bb-514e-4966-84f5-5285e94989f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2266bb-514e-4966-84f5-5285e94989f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4fe0de2-d760-4eb6-9b21-f2be9627daf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4fe0de2-d760-4eb6-9b21-f2be9627daf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8d45f3fe-2dd0-445c-a3c4-9efeadad2c71', 'volume_name': 'volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71', 'volume_size': 1, 'source_volid': 'b564344c-4a26-4bc1-bd19-ddae4fb0acfa', 'source_volstatus': 'available'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f8012d-743c-4b69-ba00-4ac645cec322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f8012d-743c-4b69-ba00-4ac645cec322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84846292-a0fc-41fc-a4c2-7a633e2ec4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:56 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Volume 8d45f3fe-2dd0-445c-a3c4-9efeadad2c71: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71', 'volume_size': 1, 'source_volid': 'b564344c-4a26-4bc1-bd19-ddae4fb0acfa', 'source_volstatus': 'available'} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:56 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6" returned: 0 in 0.523s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG cinder.utils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Path /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-786d4c98-ab92-425b-8b74-9d84306eda06 not found in is_blk_device check {{(pid=82184) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 02:12:56 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-786d4c98-ab92-425b-8b74-9d84306eda06 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:56 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-786d4c98-ab92-425b-8b74-9d84306eda06 Apr 21 02:12:56 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:58 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-786d4c98-ab92-425b-8b74-9d84306eda06" returned: 0 in 1.972s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:58 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcff5b72-de95-4290-8572-44964ab3276b]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:12:58 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:58 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 Apr 21 02:12:58 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:59 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6" returned: 0 in 0.586s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Image conversion details: src /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6, size 1024.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-786d4c98-ab92-425b-8b74-9d84306eda06 {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:12:59 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Converted 1024.00 MB image at 519.06 MB/s Apr 21 02:12:59 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-786d4c98-ab92-425b-8b74-9d84306eda06 is being set with open permissions: ugo+rw Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-786d4c98-ab92-425b-8b74-9d84306eda06 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:59 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-786d4c98-ab92-425b-8b74-9d84306eda06 Apr 21 02:12:59 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:59 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-786d4c98-ab92-425b-8b74-9d84306eda06" returned: 0 in 0.392s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Lock "cinder-quobyte-786d4c98-ab92-425b-8b74-9d84306eda06" released by "_copy_volume_from_snapshot" :: held 4.067s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Lock "cinder-quobyte-ee155fa4-8ae6-44f4-ae11-f58859062183-786d4c98-ab92-425b-8b74-9d84306eda06" released by "_create_volume_from_snapshot" :: held 4.107s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.137s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.572s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1533239560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6278b88c-ef14-436e-89e9-3c33babb7c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dea4b736e24750bfe37f0b45aa4b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:55Z,use_quota=True,user_id='df4587d2ba354cfd9e0043b8f6d524ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Creating volume 6278b88c-ef14-436e-89e9-3c33babb7c3e {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:12:59 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6278b88c-ef14-436e-89e9-3c33babb7c3e 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:12:59 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6278b88c-ef14-436e-89e9-3c33babb7c3e 1073741824 Apr 21 02:12:59 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc54fa9d-026f-4e1e-91b5-b1f14d36cffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-786d4c98-ab92-425b-8b74-9d84306eda06', 'volume_size': 1, 'snapshot_id': 'ee155fa4-8ae6-44f4-ae11-f58859062183'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7935590a-e863-47d5-a878-26ca0a12adb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:12:59 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Volume volume-786d4c98-ab92-425b-8b74-9d84306eda06 (786d4c98-ab92-425b-8b74-9d84306eda06): created successfully Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7935590a-e863-47d5-a878-26ca0a12adb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:12:59 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Flow 'volume_create_manager' (98d43f46-2f74-4706-82f5-10ae013bd45a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:12:59 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-d79d7bf1-b153-499b-b17f-effd175ac988 tempest-SnapshotDependencyTests-888735543 None] Created volume successfully. Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] Acquiring lock "cinder-ee155fa4-8ae6-44f4-ae11-f58859062183-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] Lock "cinder-ee155fa4-8ae6-44f4-ae11-f58859062183-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] Acquiring lock "cinder-quobyte-43f078cb-47dd-4da4-8123-208967f19bf6" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] Lock "cinder-quobyte-43f078cb-47dd-4da4-8123-208967f19bf6" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] Acquiring lock "cinder-quobyte-ee155fa4-8ae6-44f4-ae11-f58859062183" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] Lock "cinder-quobyte-ee155fa4-8ae6-44f4-ae11-f58859062183" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] Deleting offline snapshot ee155fa4-8ae6-44f4-ae11-f58859062183 of volume 43f078cb-47dd-4da4-8123-208967f19bf6 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] snapshot_file for this snap is: volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a9ecc7-3706-4908-8103-02a0ecf3321c]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:00 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183 Apr 21 02:13:00 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:00 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6278b88c-ef14-436e-89e9-3c33babb7c3e 1073741824" returned: 0 in 0.516s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6278b88c-ef14-436e-89e9-3c33babb7c3e {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:00 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6278b88c-ef14-436e-89e9-3c33babb7c3e Apr 21 02:13:00 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:00 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183" returned: 0 in 0.484s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f078cb-47dd-4da4-8123-208967f19bf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[217c6a1b-56f9-477a-a537-ee8324553aee]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:00 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6278b88c-ef14-436e-89e9-3c33babb7c3e" returned: 0 in 0.416s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:00 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 Apr 21 02:13:00 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.343s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1580570836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df2b008-010f-41f9-b015-0c5e0682d1f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dea4b736e24750bfe37f0b45aa4b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:55Z,use_quota=True,user_id='df4587d2ba354cfd9e0043b8f6d524ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Creating volume 2df2b008-010f-41f9-b015-0c5e0682d1f9 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:13:00 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2df2b008-010f-41f9-b015-0c5e0682d1f9 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb3536b-ec95-44c7-ad56-a19f1dc33baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6278b88c-ef14-436e-89e9-3c33babb7c3e', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:00 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2df2b008-010f-41f9-b015-0c5e0682d1f9 1073741824 Apr 21 02:13:00 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d566326c-f071-48a5-a642-a8e6066372df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:13:00 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Volume volume-6278b88c-ef14-436e-89e9-3c33babb7c3e (6278b88c-ef14-436e-89e9-3c33babb7c3e): created successfully Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d566326c-f071-48a5-a642-a8e6066372df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:00 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Flow 'volume_create_manager' (7836519c-4cc3-4c5f-8f07-3c08d9a87ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:13:00 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-8f9b58bf-f8ae-476f-8220-2a35bce3f260 tempest-CreateVolumesFromSnapshotTest-767066590 None] Created volume successfully. Apr 21 02:13:01 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6" returned: 0 in 0.463s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:01 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183 Apr 21 02:13:01 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:01 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2df2b008-010f-41f9-b015-0c5e0682d1f9 1073741824" returned: 0 in 0.488s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2df2b008-010f-41f9-b015-0c5e0682d1f9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:01 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2df2b008-010f-41f9-b015-0c5e0682d1f9 Apr 21 02:13:01 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:01 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183" returned: 0 in 0.457s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:01 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183 Apr 21 02:13:01 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:01 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2df2b008-010f-41f9-b015-0c5e0682d1f9" returned: 0 in 0.427s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.078s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1151711530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97597cf9-900f-440c-bd9d-b80fa76f2dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dea4b736e24750bfe37f0b45aa4b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:56Z,use_quota=True,user_id='df4587d2ba354cfd9e0043b8f6d524ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Creating volume 97597cf9-900f-440c-bd9d-b80fa76f2dbc {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:13:01 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-97597cf9-900f-440c-bd9d-b80fa76f2dbc 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a446be6b-db96-4b1b-ba01-4cae8cce4ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2df2b008-010f-41f9-b015-0c5e0682d1f9', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:01 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-97597cf9-900f-440c-bd9d-b80fa76f2dbc 1073741824 Apr 21 02:13:01 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c27cf3-755a-45da-b1e6-cf6430f98e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:13:01 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Volume volume-2df2b008-010f-41f9-b015-0c5e0682d1f9 (2df2b008-010f-41f9-b015-0c5e0682d1f9): created successfully Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c27cf3-755a-45da-b1e6-cf6430f98e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:01 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Flow 'volume_create_manager' (76307c18-5fc1-40be-8d69-c0a6fe158409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:13:01 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-dda31fcb-b65d-4fe3-a488-20cdf73802f2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Created volume successfully. Apr 21 02:13:02 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6.ee155fa4-8ae6-44f4-ae11-f58859062183" returned: 0 in 0.416s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] Lock "cinder-quobyte-ee155fa4-8ae6-44f4-ae11-f58859062183" released by "_delete_snapshot" :: held 1.869s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] Lock "cinder-quobyte-43f078cb-47dd-4da4-8123-208967f19bf6" released by "delete_snapshot" :: held 1.879s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] Created reservations ['fe469156-a06c-4e6a-8725-126abc448ce6', '74c3a3c8-1c22-4da6-b18a-5e367ad29089', '8977c5fb-26a8-4d77-a1db-6327574a2330', 'a02bf2a5-e3ff-4535-9675-77273607f0a4'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:13:02 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] Delete snapshot completed successfully. Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-2fad13f9-7532-4a2f-b34c-f0c0d4539872 tempest-SnapshotDependencyTests-888735543 None] Lock "cinder-ee155fa4-8ae6-44f4-ae11-f58859062183-delete_snapshot" released by "delete_snapshot" :: held 1.967s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:02 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-97597cf9-900f-440c-bd9d-b80fa76f2dbc 1073741824" returned: 0 in 0.473s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-97597cf9-900f-440c-bd9d-b80fa76f2dbc {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:02 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-97597cf9-900f-440c-bd9d-b80fa76f2dbc Apr 21 02:13:02 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] Acquiring lock "cinder-43f078cb-47dd-4da4-8123-208967f19bf6-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] Lock "cinder-43f078cb-47dd-4da4-8123-208967f19bf6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] Acquiring lock "cinder-quobyte-43f078cb-47dd-4da4-8123-208967f19bf6" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] Lock "cinder-quobyte-43f078cb-47dd-4da4-8123-208967f19bf6" acquired by "delete_volume" :: waited 0.015s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[33126e1b-cb3d-4e4d-915f-3e1752e4a7d9]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:02 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 Apr 21 02:13:02 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:02 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-97597cf9-900f-440c-bd9d-b80fa76f2dbc" returned: 0 in 0.424s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.788s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1204268322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e746b9-dbaa-4c24-ad0d-718691509662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dea4b736e24750bfe37f0b45aa4b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:56Z,use_quota=True,user_id='df4587d2ba354cfd9e0043b8f6d524ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Creating volume c5e746b9-dbaa-4c24-ad0d-718691509662 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:13:02 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c5e746b9-dbaa-4c24-ad0d-718691509662 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc7a7ea-a372-4538-a225-76a7a68cfb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97597cf9-900f-440c-bd9d-b80fa76f2dbc', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:02 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c5e746b9-dbaa-4c24-ad0d-718691509662 1073741824 Apr 21 02:13:02 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5c79ab-68c9-47dc-a444-76f5ffa845b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:13:02 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Volume volume-97597cf9-900f-440c-bd9d-b80fa76f2dbc (97597cf9-900f-440c-bd9d-b80fa76f2dbc): created successfully Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5c79ab-68c9-47dc-a444-76f5ffa845b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Flow 'volume_create_manager' (093a62dd-73bb-4b56-9b4d-40faac7143e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:13:02 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-2af29e87-b050-43f5-a480-7cdf5bb71818 tempest-CreateVolumesFromSnapshotTest-767066590 None] Created volume successfully. Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6" returned: 0 in 0.505s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:02 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:02 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:02 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6 Apr 21 02:13:02 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:03 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c5e746b9-dbaa-4c24-ad0d-718691509662 1073741824" returned: 0 in 0.469s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c5e746b9-dbaa-4c24-ad0d-718691509662 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:03 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c5e746b9-dbaa-4c24-ad0d-718691509662 Apr 21 02:13:03 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:03 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-43f078cb-47dd-4da4-8123-208967f19bf6" returned: 0 in 0.416s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] Lock "cinder-quobyte-43f078cb-47dd-4da4-8123-208967f19bf6" released by "delete_volume" :: held 0.949s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] Created reservations ['62dad46b-24b9-45ad-a3ac-9742e9f991b7', '6af6dd6a-d710-4f8d-949d-e0f2329b8839', '0a016e1f-7cc4-4f00-acdb-1323952edf3c', '8115b14b-5091-480b-bf18-3857b1d561fa'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:03 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:13:03 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] Acquiring lock "cinder-786d4c98-ab92-425b-8b74-9d84306eda06-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] Lock "cinder-786d4c98-ab92-425b-8b74-9d84306eda06-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] Acquiring lock "cinder-quobyte-786d4c98-ab92-425b-8b74-9d84306eda06" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] Lock "cinder-quobyte-786d4c98-ab92-425b-8b74-9d84306eda06" acquired by "delete_volume" :: waited 0.006s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7205f9-00d7-46be-9eb6-c51d7dee850f]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-786d4c98-ab92-425b-8b74-9d84306eda06 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:03 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-786d4c98-ab92-425b-8b74-9d84306eda06 Apr 21 02:13:03 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:03 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c5e746b9-dbaa-4c24-ad0d-718691509662" returned: 0 in 0.431s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.495s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-975906103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d5d3ce-775e-4054-8f7c-bbbec1fb8413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dea4b736e24750bfe37f0b45aa4b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:56Z,use_quota=True,user_id='df4587d2ba354cfd9e0043b8f6d524ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Creating volume 29d5d3ce-775e-4054-8f7c-bbbec1fb8413 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:13:03 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-29d5d3ce-775e-4054-8f7c-bbbec1fb8413 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30f59d6-23d5-425b-8443-f3f61c799d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e746b9-dbaa-4c24-ad0d-718691509662', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:03 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-29d5d3ce-775e-4054-8f7c-bbbec1fb8413 1073741824 Apr 21 02:13:03 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598c7457-20df-490f-b28b-25fe386c5b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:13:03 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Volume volume-c5e746b9-dbaa-4c24-ad0d-718691509662 (c5e746b9-dbaa-4c24-ad0d-718691509662): created successfully Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598c7457-20df-490f-b28b-25fe386c5b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Flow 'volume_create_manager' (31248e54-ae29-4a36-9eff-db19bd0deb95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:13:03 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-7cfa5b1a-22fc-46c1-b569-62cb79b8e807 tempest-CreateVolumesFromSnapshotTest-767066590 None] Created volume successfully. Apr 21 02:13:03 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.456s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:13:03 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] Deleted volume successfully. Apr 21 02:13:03 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-d0168855-a977-4508-bdfb-613edef30496 tempest-SnapshotDependencyTests-888735543 None] Lock "cinder-43f078cb-47dd-4da4-8123-208967f19bf6-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:04 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-786d4c98-ab92-425b-8b74-9d84306eda06" returned: 0 in 0.574s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-786d4c98-ab92-425b-8b74-9d84306eda06 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:04 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-786d4c98-ab92-425b-8b74-9d84306eda06 Apr 21 02:13:04 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:04 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-29d5d3ce-775e-4054-8f7c-bbbec1fb8413 1073741824" returned: 0 in 0.479s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-29d5d3ce-775e-4054-8f7c-bbbec1fb8413 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:04 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-29d5d3ce-775e-4054-8f7c-bbbec1fb8413 Apr 21 02:13:04 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:04 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-786d4c98-ab92-425b-8b74-9d84306eda06" returned: 0 in 0.401s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] Lock "cinder-quobyte-786d4c98-ab92-425b-8b74-9d84306eda06" released by "delete_volume" :: held 0.998s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] Created reservations ['756e4b85-5e1b-47f5-b122-ae437695f881', '15894971-ba47-4fe3-95e8-89c78656a30a', '37139c73-e09a-4b42-aad4-3e6092a2949b', 'b630a156-58ff-4fcc-ad34-87d5ec1acadd'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:04 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:13:04 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:04 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-29d5d3ce-775e-4054-8f7c-bbbec1fb8413" returned: 0 in 0.431s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.014s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54bf7e32-6dce-453a-8ee3-fb6a583da327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ac1bcee3dd64feb8bfff9ee56a55347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:12:56Z,use_quota=True,user_id='198dd0ffa77d4e9ebb5e2f4036b5580c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Creating volume 54bf7e32-6dce-453a-8ee3-fb6a583da327 {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:13:04 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-54bf7e32-6dce-453a-8ee3-fb6a583da327 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:04 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-54bf7e32-6dce-453a-8ee3-fb6a583da327 1073741824 Apr 21 02:13:04 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3519b77-33e9-4e44-be70-47521c72656b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d5d3ce-775e-4054-8f7c-bbbec1fb8413', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c89bb04-ee54-4f09-a42d-77324dd582c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:13:04 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Volume volume-29d5d3ce-775e-4054-8f7c-bbbec1fb8413 (29d5d3ce-775e-4054-8f7c-bbbec1fb8413): created successfully Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c89bb04-ee54-4f09-a42d-77324dd582c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Flow 'volume_create_manager' (2de9c6ff-0815-4a41-ad71-0686efd5ee13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:13:04 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-026caf2a-0770-4794-8fce-74d99c95530b tempest-CreateVolumesFromSnapshotTest-767066590 None] Created volume successfully. Apr 21 02:13:04 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.419s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:04 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:13:05 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] Deleted volume successfully. Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-204b84fd-f147-416a-a27c-c044fb83c073 tempest-SnapshotDependencyTests-888735543 None] Lock "cinder-786d4c98-ab92-425b-8b74-9d84306eda06-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:05 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-54bf7e32-6dce-453a-8ee3-fb6a583da327 1073741824" returned: 0 in 0.489s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-54bf7e32-6dce-453a-8ee3-fb6a583da327 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:05 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-54bf7e32-6dce-453a-8ee3-fb6a583da327 Apr 21 02:13:05 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:05 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-54bf7e32-6dce-453a-8ee3-fb6a583da327" returned: 0 in 0.400s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.837s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:05 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Cloning volume b564344c-4a26-4bc1-bd19-ddae4fb0acfa to volume 8d45f3fe-2dd0-445c-a3c4-9efeadad2c71 Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2d1f15-4547-4c72-833c-6d53c8edb528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54bf7e32-6dce-453a-8ee3-fb6a583da327', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c51f571-9d35-4537-b19b-684cbf220ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:13:05 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Volume volume-54bf7e32-6dce-453a-8ee3-fb6a583da327 (54bf7e32-6dce-453a-8ee3-fb6a583da327): created successfully Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c51f571-9d35-4537-b19b-684cbf220ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Flow 'volume_create_manager' (35c4d908-8ab0-4750-b2e9-089819a86799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Creating offline snapshot 607b5f5e-fea7-461e-9418-c75216144b19 of volume b564344c-4a26-4bc1-bd19-ddae4fb0acfa {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:13:05 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-e5ceb380-1daf-4061-9f2d-853b74df0ac2 tempest-CinderUnicodeTest-1675166588 None] Created volume successfully. Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44b4108-55ff-4bdf-b3c7-9f68f0468078]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:05 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa Apr 21 02:13:05 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "cinder-29d5d3ce-775e-4054-8f7c-bbbec1fb8413-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-29d5d3ce-775e-4054-8f7c-bbbec1fb8413-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "cinder-quobyte-29d5d3ce-775e-4054-8f7c-bbbec1fb8413" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-quobyte-29d5d3ce-775e-4054-8f7c-bbbec1fb8413" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[889e4110-52fb-47d9-a9ad-9720d6b2c7c7]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:05 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-29d5d3ce-775e-4054-8f7c-bbbec1fb8413 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:05 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-29d5d3ce-775e-4054-8f7c-bbbec1fb8413 Apr 21 02:13:05 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:06 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa" returned: 0 in 0.552s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:06 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19 1G Apr 21 02:13:06 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:06 devstack cinder-volume[82184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 02:13:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Flow 'volume_create_manager' (8c2d6599-e02b-489b-8337-f182309b54a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:13:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08f1bef-0aa2-4803-84df-5550f56584ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:13:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08f1bef-0aa2-4803-84df-5550f56584ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:13:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-809811342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ac1bcee3dd64feb8bfff9ee56a55347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:13:06Z,use_quota=True,user_id='198dd0ffa77d4e9ebb5e2f4036b5580c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66a778e-2e49-4aed-bcc3-f3073302de51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:13:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66a778e-2e49-4aed-bcc3-f3073302de51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4729b28c-1c90-481b-9f5b-3b7bf7259c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:13:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4729b28c-1c90-481b-9f5b-3b7bf7259c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb', 'volume_name': 'volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b01708-e96d-40d1-a914-5fb21435bae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:13:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b01708-e96d-40d1-a914-5fb21435bae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:06 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311d6b25-0143-4368-9352-c95c77d4297d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:13:06 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Volume 775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb', 'volume_size': 1} Apr 21 02:13:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:06 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-29d5d3ce-775e-4054-8f7c-bbbec1fb8413" returned: 0 in 0.608s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-29d5d3ce-775e-4054-8f7c-bbbec1fb8413 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:06 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-29d5d3ce-775e-4054-8f7c-bbbec1fb8413 Apr 21 02:13:06 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:06 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19 1G" returned: 0 in 0.552s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:06 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:06 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19 Apr 21 02:13:06 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:07 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-29d5d3ce-775e-4054-8f7c-bbbec1fb8413" returned: 0 in 0.524s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:07 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-quobyte-29d5d3ce-775e-4054-8f7c-bbbec1fb8413" released by "delete_volume" :: held 1.172s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:07 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] Created reservations ['9d636f05-b4b4-4dc5-be0f-3593d9fca616', '3da87403-e073-4453-9ba1-af165c191ee8', '560141c1-f6b7-46af-bb51-289f7ecd35fb', '844a521f-985e-461b-8f06-b15c2a2d9970'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:13:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:07 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:07 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:07 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:13:07 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:07 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19" returned: 0 in 0.553s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:07 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19 is being set with open permissions: ugo+rw Apr 21 02:13:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:07 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19 Apr 21 02:13:07 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:07 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.463s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:07 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:13:07 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] Deleted volume successfully. Apr 21 02:13:07 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-4be85a5c-25df-405a-a824-b3d3665207b8 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-29d5d3ce-775e-4054-8f7c-bbbec1fb8413-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:07 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19" returned: 0 in 0.461s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:07 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:07 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.info Apr 21 02:13:07 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "cinder-c5e746b9-dbaa-4c24-ad0d-718691509662-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-c5e746b9-dbaa-4c24-ad0d-718691509662-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "cinder-quobyte-c5e746b9-dbaa-4c24-ad0d-718691509662" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-quobyte-c5e746b9-dbaa-4c24-ad0d-718691509662" acquired by "delete_volume" :: waited 0.009s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e5ae54-cda6-4da2-8072-baed1c0cc447]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c5e746b9-dbaa-4c24-ad0d-718691509662 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:08 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c5e746b9-dbaa-4c24-ad0d-718691509662 Apr 21 02:13:08 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:08 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.info" returned: 0 in 0.494s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:08 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.info is being set with open permissions: ugo+rw Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:08 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.info Apr 21 02:13:08 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:08 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c5e746b9-dbaa-4c24-ad0d-718691509662" returned: 0 in 0.532s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c5e746b9-dbaa-4c24-ad0d-718691509662 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:08 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c5e746b9-dbaa-4c24-ad0d-718691509662 Apr 21 02:13:08 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:08 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.info" returned: 0 in 0.454s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Acquiring lock "cinder-quobyte-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71" by "_copy_volume_from_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] snapshot: 607b5f5e-fea7-461e-9418-c75216144b19, volume: 8d45f3fe-2dd0-445c-a3c4-9efeadad2c71, {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc129ad-a70a-42c5-a29f-e152c902b220]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:08 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:08 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19 Apr 21 02:13:08 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:09 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c5e746b9-dbaa-4c24-ad0d-718691509662" returned: 0 in 0.457s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-quobyte-c5e746b9-dbaa-4c24-ad0d-718691509662" released by "delete_volume" :: held 1.019s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] Created reservations ['83be401a-12cb-4e0a-902d-cd16cdf68fad', '4e1d331c-bba5-4424-b116-d9840752997f', '35b0906b-6245-4ba6-9f01-4a699036763d', '3558ace0-d7dc-4738-a6fa-60b780d25138'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:09 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:13:09 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:09 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19" returned: 0 in 0.509s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Creating direct copy from snapshot {{(pid=82184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8120620a-48df-4d57-b757-c3ffac0f6ee7]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:09 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa Apr 21 02:13:09 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:09 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.447s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:13:09 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] Deleted volume successfully. Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-8f495536-8da5-4446-91ab-8923933bed86 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-c5e746b9-dbaa-4c24-ad0d-718691509662-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:09 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa" returned: 0 in 0.519s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG cinder.utils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Path /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71 not found in is_blk_device check {{(pid=82184) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 02:13:09 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:09 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71 Apr 21 02:13:09 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:10 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "cinder-97597cf9-900f-440c-bd9d-b80fa76f2dbc-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:10 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-97597cf9-900f-440c-bd9d-b80fa76f2dbc-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:10 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "cinder-quobyte-97597cf9-900f-440c-bd9d-b80fa76f2dbc" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:10 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-quobyte-97597cf9-900f-440c-bd9d-b80fa76f2dbc" acquired by "delete_volume" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:10 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d524cd-014b-46fc-9d45-f5ffb147fff0]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:10 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-97597cf9-900f-440c-bd9d-b80fa76f2dbc {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:10 devstack sudo[90700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-97597cf9-900f-440c-bd9d-b80fa76f2dbc Apr 21 02:13:10 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:11 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-97597cf9-900f-440c-bd9d-b80fa76f2dbc" returned: 0 in 1.339s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-97597cf9-900f-440c-bd9d-b80fa76f2dbc {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:11 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-97597cf9-900f-440c-bd9d-b80fa76f2dbc Apr 21 02:13:11 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:11 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71" returned: 0 in 2.166s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:11 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b46d6b-01c1-4dec-9704-dd7a72ab6c01]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:11 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:12 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa Apr 21 02:13:12 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:12 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-97597cf9-900f-440c-bd9d-b80fa76f2dbc" returned: 0 in 0.582s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-quobyte-97597cf9-900f-440c-bd9d-b80fa76f2dbc" released by "delete_volume" :: held 1.964s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Created reservations ['e51fe14a-7308-4412-9bfb-0a069b74a8ff', 'fdd0be36-8c1f-4b49-a377-da0668d3b705', 'bdd58f32-8f0c-4e3a-8d9f-616b22406d7c', '8aa01d0f-648e-4f1a-afde-54b4d6e85060'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:12 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:13:12 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "cinder-2df2b008-010f-41f9-b015-0c5e0682d1f9-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-2df2b008-010f-41f9-b015-0c5e0682d1f9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "cinder-quobyte-2df2b008-010f-41f9-b015-0c5e0682d1f9" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-quobyte-2df2b008-010f-41f9-b015-0c5e0682d1f9" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a024104b-1df2-4792-88f4-ea5bcebf5e76]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2df2b008-010f-41f9-b015-0c5e0682d1f9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:12 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa" returned: 0 in 0.726s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG cinder.image.image_utils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Image conversion details: src /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa, size 1024.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71 {{(pid=82184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 02:13:12 devstack cinder-volume[82184]: INFO cinder.image.image_utils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Converted 1024.00 MB image at 472.53 MB/s Apr 21 02:13:12 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71 is being set with open permissions: ugo+rw Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:12 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71 Apr 21 02:13:12 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:12 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2df2b008-010f-41f9-b015-0c5e0682d1f9 Apr 21 02:13:12 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:12 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.523s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:13:12 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Deleted volume successfully. Apr 21 02:13:12 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-0ab3a081-cdc1-400e-957f-64dbcae717d2 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-97597cf9-900f-440c-bd9d-b80fa76f2dbc-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:13 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71" returned: 0 in 0.493s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71" released by "_copy_volume_from_snapshot" :: held 4.453s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Acquiring lock "cinder-quobyte-607b5f5e-fea7-461e-9418-c75216144b19" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-607b5f5e-fea7-461e-9418-c75216144b19" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Deleting offline snapshot 607b5f5e-fea7-461e-9418-c75216144b19 of volume b564344c-4a26-4bc1-bd19-ddae4fb0acfa {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] snapshot_file for this snap is: volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ed3a10-04d8-4e61-996c-068d3ad30210]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:13 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2df2b008-010f-41f9-b015-0c5e0682d1f9" returned: 0 in 0.610s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2df2b008-010f-41f9-b015-0c5e0682d1f9 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:13 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2df2b008-010f-41f9-b015-0c5e0682d1f9 Apr 21 02:13:13 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:13 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19 Apr 21 02:13:13 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:13 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-2df2b008-010f-41f9-b015-0c5e0682d1f9" returned: 0 in 0.434s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-quobyte-2df2b008-010f-41f9-b015-0c5e0682d1f9" released by "delete_volume" :: held 1.068s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:13 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19" returned: 0 in 0.473s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd06236-1248-48b0-8f60-b9f424cec25b]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] Created reservations ['1adf98d7-a6a3-48f3-aad7-8f62ae425a49', '536484f9-bbdb-4387-8cf1-108000ecd616', '50d609ec-1b9f-4e16-8e85-4b508c53d65d', '4e851124-5c27-48d0-91c5-f6347b3e024b'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:13 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa Apr 21 02:13:13 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:13 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:13 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:13:13 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:14 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa" returned: 0 in 0.463s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:14 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19 Apr 21 02:13:14 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:14 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.439s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:14 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:13:14 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] Deleted volume successfully. Apr 21 02:13:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-b7b2b0e8-f2a2-4f35-bb1e-96e0f71ea92f tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-2df2b008-010f-41f9-b015-0c5e0682d1f9-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:14 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19" returned: 0 in 0.440s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:14 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19 Apr 21 02:13:14 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "cinder-6278b88c-ef14-436e-89e9-3c33babb7c3e-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-6278b88c-ef14-436e-89e9-3c33babb7c3e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "cinder-quobyte-6278b88c-ef14-436e-89e9-3c33babb7c3e" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:14 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-quobyte-6278b88c-ef14-436e-89e9-3c33babb7c3e" acquired by "delete_volume" :: waited 0.006s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:14 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f509700-2872-46ca-9544-d3ed5331b9bd]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:14 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6278b88c-ef14-436e-89e9-3c33babb7c3e {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:14 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6278b88c-ef14-436e-89e9-3c33babb7c3e Apr 21 02:13:14 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:15 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa.607b5f5e-fea7-461e-9418-c75216144b19" returned: 0 in 0.426s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-607b5f5e-fea7-461e-9418-c75216144b19" released by "_delete_snapshot" :: held 1.852s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.520s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.603s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T00:13:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-809811342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ac1bcee3dd64feb8bfff9ee56a55347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:13:06Z,use_quota=True,user_id='198dd0ffa77d4e9ebb5e2f4036b5580c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784b3356-38cb-4402-8c1f-1efafec33a91),volume_type_id=784b3356-38cb-4402-8c1f-1efafec33a91)}" {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Creating volume 775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb {{(pid=82184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Selected osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b as target Quobyte volume. {{(pid=82184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 02:13:15 devstack cinder-volume[82184]: INFO cinder.volume.drivers.remotefs [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] casted to osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb 1073741824 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84846292-a0fc-41fc-a4c2-7a633e2ec4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71', 'volume_size': 1, 'source_volid': 'b564344c-4a26-4bc1-bd19-ddae4fb0acfa', 'source_volstatus': 'available'}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d2698c-252b-4630-af09-52fd0f1be9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:13:15 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb 1073741824 Apr 21 02:13:15 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:15 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Volume volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71 (8d45f3fe-2dd0-445c-a3c4-9efeadad2c71): created successfully Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d2698c-252b-4630-af09-52fd0f1be9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Flow 'volume_create_manager' (f439aa83-7298-4809-aad5-b267244d0979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:13:15 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-3e7918a6-73a6-48e3-a75b-c7f685106abc tempest-VolumeDependencyTests-952227776 None] Created volume successfully. Apr 21 02:13:15 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6278b88c-ef14-436e-89e9-3c33babb7c3e" returned: 0 in 0.491s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6278b88c-ef14-436e-89e9-3c33babb7c3e {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:15 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6278b88c-ef14-436e-89e9-3c33babb7c3e Apr 21 02:13:15 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:15 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb 1073741824" returned: 0 in 0.459s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:15 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb Apr 21 02:13:15 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:15 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-6278b88c-ef14-436e-89e9-3c33babb7c3e" returned: 0 in 0.442s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-quobyte-6278b88c-ef14-436e-89e9-3c33babb7c3e" released by "delete_volume" :: held 0.955s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] Acquiring lock "cinder-b564344c-4a26-4bc1-bd19-ddae4fb0acfa-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] Lock "cinder-b564344c-4a26-4bc1-bd19-ddae4fb0acfa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] Acquiring lock "cinder-quobyte-b564344c-4a26-4bc1-bd19-ddae4fb0acfa" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] Created reservations ['2cc11087-6b7b-4389-9977-2fe5d575c657', '55a9f426-ee90-41f8-966f-513c0554f485', '4c2dcdc0-a9d1-40cd-a36f-67b9e93b5064', 'a2474f88-2504-4c19-a34f-f7480ae9f5c4'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-b564344c-4a26-4bc1-bd19-ddae4fb0acfa" acquired by "delete_volume" :: waited 0.044s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea8cfd5-0db7-4782-a864-b52b2743649c]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:15 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:13:15 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:15 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa Apr 21 02:13:15 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:15 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb" returned: 0 in 0.436s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'} {{(pid=82184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311d6b25-0143-4368-9352-c95c77d4297d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb', 'volume_size': 1}' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:15 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f278f6b-fc49-451b-b797-2628755023b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 02:13:16 devstack cinder-volume[82184]: INFO cinder.volume.flows.manager.create_volume [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Volume volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb (775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb): created successfully Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f278f6b-fc49-451b-b797-2628755023b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG cinder.volume.manager [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Flow 'volume_create_manager' (8c2d6599-e02b-489b-8337-f182309b54a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 02:13:16 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-ea07d9bb-47a0-4818-bd88-eeb22f859e02 tempest-CinderUnicodeTest-1675166588 None] Created volume successfully. Apr 21 02:13:16 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.406s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:13:16 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] Deleted volume successfully. Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-dc621b36-50ea-46ae-965d-302ba1850900 tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-6278b88c-ef14-436e-89e9-3c33babb7c3e-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:16 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa" returned: 0 in 0.509s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:16 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa Apr 21 02:13:16 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:16 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-b564344c-4a26-4bc1-bd19-ddae4fb0acfa" returned: 0 in 0.388s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-b564344c-4a26-4bc1-bd19-ddae4fb0acfa" released by "delete_volume" :: held 0.935s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] Created reservations ['b70b8d58-fab9-43bd-af34-923c928b4a86', '012e9146-7ddb-452e-a5b4-12c09ced470a', '79c8471f-7db3-444c-b71b-38608ea9dd29', '8c217c81-9d9e-4383-adba-017518f0b176'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:16 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:13:16 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "cinder-d6fc620b-a3c9-41f0-825a-16cd3d1c1b49-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-d6fc620b-a3c9-41f0-825a-16cd3d1c1b49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "cinder-quobyte-c420a28f-9bbb-4651-b4bd-11047994d4d6" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-quobyte-c420a28f-9bbb-4651-b4bd-11047994d4d6" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "cinder-quobyte-d6fc620b-a3c9-41f0-825a-16cd3d1c1b49" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-quobyte-d6fc620b-a3c9-41f0-825a-16cd3d1c1b49" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] Deleting offline snapshot d6fc620b-a3c9-41f0-825a-16cd3d1c1b49 of volume c420a28f-9bbb-4651-b4bd-11047994d4d6 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] snapshot_file for this snap is: volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49 {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc1e88c-bac8-48bd-b66c-23d35e452853]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:16 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:16 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49 Apr 21 02:13:16 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] Creating offline snapshot 4936cac0-9623-47ea-81ae-b0e506251ebe of volume 775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb {{(pid=82184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2441e61-f51c-43c2-9a41-b1fb3aa4a5ab]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:17 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb Apr 21 02:13:17 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:17 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.451s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:13:17 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] Deleted volume successfully. Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-fcdba216-1195-42b3-82b4-e07407c26a7d tempest-VolumeDependencyTests-952227776 None] Lock "cinder-b564344c-4a26-4bc1-bd19-ddae4fb0acfa-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:17 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49" returned: 0 in 0.515s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c420a28f-9bbb-4651-b4bd-11047994d4d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b765788-226a-42e8-ad99-12a8504b701c]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:17 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6 Apr 21 02:13:17 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:17 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb" returned: 0 in 0.506s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe 1G {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:17 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe 1G Apr 21 02:13:17 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] Acquiring lock "cinder-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] Lock "cinder-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] Acquiring lock "cinder-quobyte-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:17 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6" returned: 0 in 0.481s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71" acquired by "delete_volume" :: waited 0.024s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40c0efa-1346-4ee0-b4b9-4e9f6cfb3b27]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:17 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49 Apr 21 02:13:17 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:17 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:18 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71 Apr 21 02:13:18 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:18 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe 1G" returned: 0 in 0.537s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:18 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe Apr 21 02:13:18 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:18 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49" returned: 0 in 0.462s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:18 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49 Apr 21 02:13:18 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:18 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71" returned: 0 in 0.499s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:18 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71 Apr 21 02:13:18 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:18 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb -F qcow2 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe" returned: 0 in 0.399s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:18 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe is being set with open permissions: ugo+rw Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:18 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe Apr 21 02:13:18 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:18 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6.d6fc620b-a3c9-41f0-825a-16cd3d1c1b49" returned: 0 in 0.397s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-quobyte-d6fc620b-a3c9-41f0-825a-16cd3d1c1b49" released by "_delete_snapshot" :: held 1.917s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-quobyte-c420a28f-9bbb-4651-b4bd-11047994d4d6" released by "delete_snapshot" :: held 1.930s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] Created reservations ['a3faacdb-0503-4ac9-8f56-9ae577bb70b9', '72f707b3-b234-443a-9d4f-ecd06abfb495', 'f93c518c-783a-406d-8214-c500326565e6', 'b5a4be00-6161-47b8-9060-443c23608a8f'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:13:18 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:18 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] Delete snapshot completed successfully. Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-51f80cd1-8f42-4629-9945-b410bc7bcd2c tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-d6fc620b-a3c9-41f0-825a-16cd3d1c1b49-delete_snapshot" released by "delete_snapshot" :: held 2.015s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71" returned: 0 in 0.435s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71" released by "delete_volume" :: held 0.956s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] Created reservations ['685eb35f-0be4-4388-9854-0669e60ae507', 'ae93645e-b992-48aa-abcf-df380f355471', '30bb468d-fe0a-4a0d-8153-92e89a37c47f', '0ad5b7c3-fbcf-47d8-be1f-1be4a74717f8'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:18 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:18 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:13:18 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "cinder-c420a28f-9bbb-4651-b4bd-11047994d4d6-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:19 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe" returned: 0 in 0.423s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-c420a28f-9bbb-4651-b4bd-11047994d4d6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] Acquiring lock "cinder-4d4ff573-14e9-49ba-ad28-e45232369ed8-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "cinder-quobyte-c420a28f-9bbb-4651-b4bd-11047994d4d6" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:19 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.info Apr 21 02:13:19 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] Lock "cinder-4d4ff573-14e9-49ba-ad28-e45232369ed8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-quobyte-c420a28f-9bbb-4651-b4bd-11047994d4d6" acquired by "delete_volume" :: waited 0.022s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5f117b-0385-4e00-8b91-c281f2d27861]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] Acquiring lock "cinder-quobyte-4d4ff573-14e9-49ba-ad28-e45232369ed8" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-4d4ff573-14e9-49ba-ad28-e45232369ed8" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ef007f-e34b-4825-952d-b22e2f49532a]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d4ff573-14e9-49ba-ad28-e45232369ed8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:19 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6 Apr 21 02:13:19 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:19 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d4ff573-14e9-49ba-ad28-e45232369ed8 Apr 21 02:13:19 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:19 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.471s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:13:19 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] Deleted volume successfully. Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-46cf2cd5-63d4-4569-834b-9f60137b4c35 tempest-VolumeDependencyTests-952227776 None] Lock "cinder-8d45f3fe-2dd0-445c-a3c4-9efeadad2c71-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:19 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.info" returned: 0 in 0.431s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:19 devstack cinder-volume[82184]: WARNING cinder.volume.drivers.remotefs [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.info is being set with open permissions: ugo+rw Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.info {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:19 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.info Apr 21 02:13:19 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:19 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6" returned: 0 in 0.493s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:19 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6 Apr 21 02:13:19 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:19 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d4ff573-14e9-49ba-ad28-e45232369ed8" returned: 0 in 0.489s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d4ff573-14e9-49ba-ad28-e45232369ed8 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:19 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d4ff573-14e9-49ba-ad28-e45232369ed8 Apr 21 02:13:19 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:19 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.info" returned: 0 in 0.379s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:19 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.763s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:19 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-be8490b6-3487-4292-aec0-4150616bcc86 tempest-CinderUnicodeTest-1675166588 None] Create snapshot completed successfully Apr 21 02:13:20 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-c420a28f-9bbb-4651-b4bd-11047994d4d6" returned: 0 in 0.420s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-quobyte-c420a28f-9bbb-4651-b4bd-11047994d4d6" released by "delete_volume" :: held 0.940s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] Created reservations ['cbc74ea7-2da0-4f3f-82d9-939dc494e5c1', 'aa414341-253a-47fe-8a9d-0528edef7b74', '28480ed9-063d-4ddd-87d6-46c29be67593', '29deec28-9d4b-4d1a-8fc9-f341e45476ba'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:13:20 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-4d4ff573-14e9-49ba-ad28-e45232369ed8" returned: 0 in 0.439s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] Lock "cinder-quobyte-4d4ff573-14e9-49ba-ad28-e45232369ed8" released by "delete_volume" :: held 0.956s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:20 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:13:20 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] Created reservations ['f197ae47-6d1c-4ef6-9a1d-2479589139a8', 'f788bb7e-80d2-46fc-99d4-01e8483b4f14', '43fd4bb0-d5f8-4eae-8587-a0243745f524', '06c0bb0e-288f-4636-a642-e88d4d9791e9'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:20 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:13:20 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] Acquiring lock "cinder-4936cac0-9623-47ea-81ae-b0e506251ebe-delete_snapshot" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] Lock "cinder-4936cac0-9623-47ea-81ae-b0e506251ebe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] Acquiring lock "cinder-quobyte-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb" by "delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] Lock "cinder-quobyte-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] Acquiring lock "cinder-quobyte-4936cac0-9623-47ea-81ae-b0e506251ebe" by "_delete_snapshot" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] Lock "cinder-quobyte-4936cac0-9623-47ea-81ae-b0e506251ebe" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] Deleting offline snapshot 4936cac0-9623-47ea-81ae-b0e506251ebe of volume 775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] snapshot_file for this snap is: volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe {{(pid=82184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35be8c3-45a3-48d2-9e05-227cdae58654]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:20 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe Apr 21 02:13:20 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:20 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.426s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:13:20 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] Deleted volume successfully. Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-05bb8eee-7782-4dae-938d-17cee353c9cf tempest-CreateVolumesFromSnapshotTest-767066590 None] Lock "cinder-c420a28f-9bbb-4651-b4bd-11047994d4d6-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:20 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.438s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:13:20 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] Deleted volume successfully. Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-6f19ab2e-5573-48d6-a5e0-ae296ae81755 tempest-VolumeDependencyTests-952227776 None] Lock "cinder-4d4ff573-14e9-49ba-ad28-e45232369ed8-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:20 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe" returned: 0 in 0.465s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.remotefs [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab0e42e-330b-4581-9c83-fa1855386f0a]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:20 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:20 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb Apr 21 02:13:20 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:21 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb" returned: 0 in 0.521s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:21 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe Apr 21 02:13:21 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:21 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe" returned: 0 in 0.540s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:21 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:21 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe Apr 21 02:13:21 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:22 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:22 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb.4936cac0-9623-47ea-81ae-b0e506251ebe" returned: 0 in 0.522s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] Lock "cinder-quobyte-4936cac0-9623-47ea-81ae-b0e506251ebe" released by "_delete_snapshot" :: held 2.122s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] Lock "cinder-quobyte-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb" released by "delete_snapshot" :: held 2.136s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:22 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] Created reservations ['11ef694e-8bce-45c3-a6d4-a733f21524ad', 'b4c60bc0-cb66-4fcf-a1fc-219febd2d6f6', '2b8504e8-9d77-488d-8f03-f32e36e66084', 'c4bd9175-dc83-4a38-ba6a-49b4bffcd549'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:13:22 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] Delete snapshot completed successfully. Apr 21 02:13:22 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-eb9bc50f-6627-4d20-8e0c-adcd77171916 tempest-CinderUnicodeTest-1675166588 None] Lock "cinder-4936cac0-9623-47ea-81ae-b0e506251ebe-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] Acquiring lock "cinder-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] Lock "cinder-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] Acquiring lock "cinder-quobyte-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:23 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] Lock "cinder-quobyte-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb" acquired by "delete_volume" :: waited 0.012s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:23 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0e2f9e-ce83-4bf8-a534-487e1c65049e]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:23 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb Apr 21 02:13:23 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:23 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb" returned: 0 in 0.474s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:23 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:24 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb Apr 21 02:13:24 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:24 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb" returned: 0 in 0.412s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:24 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] Lock "cinder-quobyte-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb" released by "delete_volume" :: held 0.911s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:24 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] Created reservations ['443ab07e-6d7d-41c9-8c4f-08b8d26ad1ea', '45d98904-10af-4222-8bc9-d404e619add1', '2f58d11d-ac31-4c65-95ed-b05a6aab68b9', 'fa6bce20-5644-4222-b47c-002012c2a382'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:13:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:24 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:24 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:13:24 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:24 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] Acquiring lock "cinder-54bf7e32-6dce-453a-8ee3-fb6a583da327-delete_volume" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:24 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] Lock "cinder-54bf7e32-6dce-453a-8ee3-fb6a583da327-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:24 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] Acquiring lock "cinder-quobyte-54bf7e32-6dce-453a-8ee3-fb6a583da327" by "delete_volume" {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 02:13:24 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] Lock "cinder-quobyte-54bf7e32-6dce-453a-8ee3-fb6a583da327" acquired by "delete_volume" :: waited 0.007s {{(pid=82184) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 02:13:24 devstack cinder-volume[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c848cbc-b52e-4933-a335-a62003885b2c]: (4, 'qcow2') {{(pid=83041) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 02:13:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-54bf7e32-6dce-453a-8ee3-fb6a583da327 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:24 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-54bf7e32-6dce-453a-8ee3-fb6a583da327 Apr 21 02:13:24 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:24 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:24 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.419s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:24 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:13:24 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] Deleted volume successfully. Apr 21 02:13:24 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-ce1e55fc-c705-4e34-8556-cf0f3fc82480 tempest-CinderUnicodeTest-1675166588 None] Lock "cinder-775a25e2-46f8-4b56-a3d2-c3a7d8a04fcb-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:25 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-54bf7e32-6dce-453a-8ee3-fb6a583da327" returned: 0 in 0.488s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-54bf7e32-6dce-453a-8ee3-fb6a583da327 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:25 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-54bf7e32-6dce-453a-8ee3-fb6a583da327 Apr 21 02:13:25 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:25 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37/volume-54bf7e32-6dce-453a-8ee3-fb6a583da327" returned: 0 in 0.419s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:25 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] Lock "cinder-quobyte-54bf7e32-6dce-453a-8ee3-fb6a583da327" released by "delete_volume" :: held 0.928s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:25 devstack cinder-volume[82184]: DEBUG cinder.quota [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] Created reservations ['6ba10b13-ed5e-4750-9d41-cf16f1a3ee12', '004e9216-9d08-4bd6-873f-68a8620153ff', 'acdf5d5b-1f0e-462f-b61e-70dcdffeff0d', '097d01d6-a19c-4696-ab98-6fe4acb28d59'] {{(pid=82184) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 02:13:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 02:13:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 02:13:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b': None} {{(pid=82184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 02:13:25 devstack cinder-volume[82184]: DEBUG cinder.volume.drivers.quobyte [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-628e0b2b-aa74-4953-99de-6d9b19b1f16b'] {{(pid=82184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 02:13:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.lockutils [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 02:13:25 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 02:13:25 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37 Apr 21 02:13:25 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 02:13:26 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Apr 21 02:13:26 devstack cinder-volume[82184]: DEBUG oslo_concurrency.processutils [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0287ae11e5d6618a1539d6ad0e7f1b37" returned: 0 in 0.456s {{(pid=82184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 02:13:26 devstack cinder-volume[82184]: DEBUG cinder.manager [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] Notifying Schedulers of capabilities ... {{(pid=82184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 02:13:26 devstack cinder-volume[82184]: INFO cinder.volume.manager [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] Deleted volume successfully. Apr 21 02:13:26 devstack cinder-volume[82184]: DEBUG cinder.coordination [None req-1c5f643a-a4d5-4b8d-af9a-72893989f670 tempest-CinderUnicodeTest-1675166588 None] Lock "cinder-54bf7e32-6dce-453a-8ee3-fb6a583da327-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=82184) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 02:13:35 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:SELECT=189,cinder:INSERT=51,cinder:UPDATE=293,cinder:DELETE=14 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 02:13:36 devstack cinder-volume[82184]: DEBUG dbcounter [-] [82184] Writing DB stats cinder:UPDATE=229,cinder:SELECT=175,cinder:DELETE=31,cinder:INSERT=78 {{(pid=82184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}